AD-A033  721 


UNCLASSIFIED 


ACA  GOVERNMENT  A NO  COMMERCIAL  SYSTEMS  BURLINGTON  MASS— ETC  F/G  15/5 
FICLO  EVALUATION  OF  UH-lH  hE. ICOPTER  INSPECTION  SYSTEMS.  PROJEC--ETC(U) 
NOV  7i  f I HOHN#  B B MIERENGA*  J M BAROIS  OAAJ02-7H-C-0044 

USAAMR0L-TR-7G-27  NL 


ADAO  33  7 2 1 


FIELD  EVALUATION  OF  UH-1H  HELICOPTER  INSPECTION  SYSTEMS 
PROJECT  INSPECT  - PHASE  II 


RCA  Government  and  Commercial  Systems 
Automated  Systems  Division 
Burlington,  Mass.  01803 


November  1976 


Final  Report  for  Period  1 May  1974  - 31  May  1976 


1 

Approved  for  public  release; 
distribution  unlimited. 


Prepared  for 
EUSTIS  DIRECTORATE 

U.  S.  ARMY  AIR  MOBILITY  RESEARCH  AND  DEVELOPMENT  LABORATORY 
Fort  Eustis,  Va.  23604 


jL 


4 


EUSTIS  DIRECTORATE  POSITION  STATEMENT 


/ 

i 


This  report  and  the  MAVIS  Users  Manual  provide  the  foundation  from 
which  improved  maintenance  checklists  for  all  other  Army  aircraft  can 
be  produced. 
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Systems  Division  and  reported  herein  is  considered  to  be  thorough  and 
comprehensive . 

This  effort  established  the  effectiveness  of  the  Model  for  Analysis  of 
Vehicle  Inspection  Systems  (MAVIS)  in  the  structuring  of  phased  in- 
spection schemes  for  Army  helicopters  having  the  capability  of  reducing 
maintenance  man-hours  per  flying  hour  and  increasing  availability  with- 
out compromising  safety.  This  scientific  approach  is  an  attempt  by  the 
Army  to  match  the  revolution  in  aircraft  designs  and  configurations 
with  equally  advanced  maintenance  concepts.  The  presently  used  in- 
spection schemes  have  been  virtually  unchanged  in  over  two  decades, 
during  which  great  strides  in  helicopter  developments  occurred. 
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The  Department  of  the  Army  established  Project  Inspect^to  analyze  aircraft 
maintenance  scheduled  inspections  and  to  design  an  improved  schedule  inspectioi 
scheme  that  will,  function  effectively  in  the  era  of  the  volunteer  Army. 

RCA  studied  the  various  priorities  associated  with,  preventive  maintenance 
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scheduled  inspection  systems  of  Army  aircraft, and  the  resulting  restructuring 
of  these  systems  is  based  on  the  analysis  of  ^historical  data  and  the  modeling 
results  of  a developed  computer  program,  MAVIS  (Model  for  Analysis  of  Vehicle  - 


UNCLASSIFIED 

SECURITY  CLASSIFICATION  of  this  PAOt 


409  S/G 


UNCLASSIFIED 

SICUNITV  CLASSIFICATION  OF  THIS  F»Ct  f»ll«  Data  Filar rd) 


B Lock  20.  Continued 

-^Inspection  Systems).  The  output  of  this  effort  indicated  that  proper  scheduling 
of  individual  component  inspections  based  on  failure  and  failure  detection  his- 
torical data  permits  an  increase  in  inspection  intervals,  resulting  in  increased 
efficiency  and  maintenance  cost  savings..  MAVIS  development  work  also  indicated 
that  a phased  inspection  schedule  was  the  most  advantageous  for  Army  use. 


— ) Project  Inspect  then  developed  a phased  checklist  for  the  UH-1H  Helicopter.  The 
implementation  of  a scientifically  derived  phased  inspection  schedule  with 
opened  intervals  should  result  in  greater  inspection  efficiency,  reduced  main- 
tenance costs,  and  increased  operational  readiness..— However,  proof  was  needed 
to  establish  the  validity  of  MAVIS  modeling  concepts  \and  the  value  of  projected 
efficiency  improvements  and  cost  savings.  1 

Project  Inspect,  Phase  II,  has  been  employed  to  furnish  the  required  demonstra- 
tion under  operational  conditions.  Phase  II  is  a semicontrolled  sample  data 
collection  program  conducted  as  a field  test  to  determine  the  acceptance  of  the 
UH-1H  phased  inspection  schedule.  Goals  of  the  program  were  to  refine  and 
validate  the  MAVIS  Model,  refine  the  UH-1H  Phased  Inspection  Checklist,  and 
release  MAVIS  to  the  Army. 


Project  Inspect,  Phase  II,  has  successfully  proved  that  the  MAVIS  Model  can 
produce  inspection  schedules  and  checklists  which  provide  increased  inspection 
efficiency  at  reduced  cost  without  jeopardizing  aircraft  safety.  In  addition, 
the  integration  of  the  MAVIS  designed  phased  inspection  checklist  into  Army 
operational  activity  was  accomplished  with  ease  and  was  well  received  by  Fort 
Campbell  user  personnel. 

The  largest  problem  faced  by  the  field  evaluation  was  accurate  data  recording. 
It  can  be  concluded  that  data  collection  within  the  Army  must  be  controlled  for 
it  to  be  useful  in  maintenance  planning. 


Several  recommendations  are  provided  in  this  report;  among  the  more  important 
are; 


• MAVIS-designed  Phased  Inspection  Schedules  should  be  implemented  for  other 
aircraft  in  the  Army  inventory  and  for  new  aircraft  that  are  scheduled  to 
become  a part  of  the  inventory.  Once  an  inspection  schedule  becomes  opera- 
tional, it  should  be  periodically  reexamined  and  updated  using  the  same 
design  technique  it  was  implemented  by  (MAVIS  Analysis). 

• Sample  Data  Collection  (SDC)  should  be  widely  used  to  provide  needed  mainten- 
ance planning  data.  It  is  recommended  that  the  semicontrolled  method  of  SDC 
be  employed.  Future  automation  of  Aviation  SDC  should  be  considered  now. 
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The  Field  Evaluation  of  UH-lH  Helicopter  Inspection  Systems  was 
performed  under  Contract  DAAJ02-74-C-0044  with  the  Eustis  Direc- 
torate, U.S.  Army  Air  Mobility  Research  and  Development  Labora- 
tory (USAAMRDL),  Fort  Eustis,  Virginia.  This  program  is  known 
within  the  Army  as  Project  Inspect,  Phase  II.  The  program  was 
initiated  under  the  technical  cognizance  of  LTC  Robert  A.  Mangum 
and  completed  under  the  guidance  of  MAJ  Roland  G.  Fontaine  of  the 
Reliability  and  Maintainability  Division,  USAAMRDL.  Project  In- 
spect, Phase  II,  was  a sample  data  program  conducted  as  a field 
test  to  determine  the  acceptance  of  a phased  inspection  schedule 
by  an  operational  Army  group.  Goals  were  to  refine  and  validate 
a computer  model  having  the  capability  to  produce  inspection 
schedules  with  increased  operational  readiness  at  reduced  cost, 
to  refine  the  UH-lH  Phased  Inspection  Checklist,  and  to  release 
the  computer  model  to  the  Army.  Project  Inspect  has  met  these 
goals;  the  field  data  has  indicated  positive  results,  and  the 
phased  inspection  schedule  was  enthusiastically  accepted. 

The  primary  participating  U.S.  Army  forces  were  the  101st  AVN  GP 
(CBT) , 101st  ABN  DIV  (AMBL) , Fort  Campbell,  Kentucky.  The  men  of 
B,  C,  and  D Companies  of  the  101st  and  158th  AVN  BNs  are  thanked 
for  their  cooperation  and  many  contributions.  Making  possible 
the  collection  of  accurate  data  was  the  field  office  headed  by 
Mr.  Frank  Jellerson,  RCA  Service  Company  and  aided  by  Ms. 

Patricia  Birkby,  RCA  Service  Company;  Mr.  George  Schroer,  AVSCOM; 
CW4  James  Gerretson,  AVSCOM;  and  SFC  Walter  Galloway,  HHC  101st 
AVN  GP,  Fort  Campbell.  Mr.  Schroer' s help  was  invaluable  during 
the  setup  of  the  data  collection  system  and  in  establishing  uni- 
form data  recording. 

Six  Study  Advisory  Group  sessions  were  held  to  guide  the  program 
through  completion.  In  addition  to  those  listed  above,  inesti- 
mable direction  was  provided  by  LTC  James  Brier,  DCSLOG;  Mr. 

Blair  Poteate,  Jr. , USAAMRDL;  Mr.  George  Turton,  DARCOM;  MAJ 
Richard  Ladd,  HQ-MASSTER;  Mr.  Thomas  Greuninger,  AVSCOM;  Mr.  John 
Bauer,  AVSCOM;  Mr.  Samuel  Coffman,  AVSCOM;  Mr.  Jack  McCluskie, 
AVSCOM;  CPT  John  Sheehan,  MMC;  and  SFC  Ben  Honaker,  USAAAVS. 

It  should  also  be  noted  that  Mr.  Frank  Starses  served  during  the 
program  as  aircraft  reliability  and  maintainability  consultant. 
Mr.  Starses  was  instrumental  in  updating  the  UH-lH  R&M  data  bank 
and  refining  the  UH-lH  Phased  Inspection  Checklist.  He  is  em- 
ployed by  Kaman  Aerospace  Corporation,  Bloomfield,  Connecticut. 
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BACKGROUND  INFORMATION 


The  RCA  Corporation,  with  Kaman  Aerospace  Corporation  as  a major 
subcontractor,  completed  three  studies  under  contract  to  the 
Eustis  Directorate  of  the  U.S.  Army  Air  Mobility  Research  and 
Development  Laboratory.  The  objectives  of  these  studies  (Con- 
tracts DAAJ02-71-C-0047 , DAAJ02-72-C-0052 , and  DAAJ02-73-C-0018) 
were  to  analyze  the  existing  schemes  of  aircraft  maintenance 
scheduled  inspection,  to  provide  specific  design  approaches  for 
improving  the  inspection  function  in  future  aircraft,  to  optimize 
a desirable  inspection  scheme,  and  to  select  inspection  schemes 
for  the  UH-lH  and  CH-47C  helicopters.  This  work  included  the  de- 
velopment and  application  of  a computer  model  (MAVIS-Model  for 
Analysis  of  Vehicle  Inspection  Systems)  that  analyzes  the  effec- 
tiveness of  the  scheduled  inspection  schemes.  In  addition,  in- 
spection checklists  for  these  aircraft  were  generated  and  vali- 
dated in  accordance  with  the  selected  inspection  schemes.  The 
latter  work  is  identified  as  Project  Inspect  - Phase  I.  A 100- 
hour  interval  and  an  800-hour  cycle  time  was  recommended  as  the 
inspection  system  for  the  UH-lH  helicopter  and  a 30-hour  interval 
400-hour  cycle  was  recommended  for  the  CH-47C. 

The  effort  included  in  the  above  tasks  was  devoted  to  the  reor- 
dering of  the  various  priorities  associated  with  preventive  main- 
tenance scheduled  inspection  systems  of  Army  aircraft.  The  re- 
sulting reordering  is  based  on  the  analysis  of  historical  data 
and  the  modeling  results  of  the  developed  computer  program.  The 
output  of  this  effort  indicated  that  proper  scheduling  of  individ 
ual  cctiDonent  inspections  based  on  failure  and  failure  detection 
historical  data  permits  an  increase  in  inspection  intervals,  re- 
sulting in  increased  efficiency  and  maintenance  cost  savings. 
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INTRODUCTION 


PROJECT  INSPECT 'S  OBJECTIVES 


The  Department  of  the  Army  established  Project  Inspect  to  analyze 
aircraft  maintenance  scheduled  inspections  and  to  design  an  im- 
proved schedule  inspection  scheme  that  will  function  effectively 
in  the  era  of  the  volunteer  Army.  RCA  found  through  analysis, 
field  surveys,  and  discussions  with  Army  operational  personnel 
that  current  preventive  inspections  constitute  a form  of  "over- 
kill" to  the  inspection  problem.  Overinspection  of  Army  aircraft 
is  believed  to  not  only  cause  increased  labor  demands  on  mainten- 
ance personnel,  but  cause  increased  spares  usage,  reduce  critical 
component  time  between  overhauls  (TBO's),  and  cause  increases  in 
maintenance-induced  failures,  including  foreign  object  damage 
(FOD) . Project  Inspect,  Phase  II,  was  designed  to  test  a phased 
inspection  schedule  for  the  UH-1H  helicopter  and  to  verify  the 
above  suppositions. 

The  objectives  of  Project  Inspect  are  to  reduce  the  maintenance 
workload  on  aviation  unit  personnel  and  to  increase  aircraft  op- 
erational readiness.  The  implementation  of  a scientifically  de- 
rived phased  inspection  schedule  with  opened  intervals  should 
result  in  greater  inspection  efficiency,  reduced  maintenance 
costs,  and  increased  operational  readiness.  Project  Inspect 
Phase  II,  the  field  evaluation  and  test  of  this  inspection 
schedule,  has  provided  a demonstration  and  verification  of  these 
concepts . 

CONTENTS  OF  REPORT 


This  report  discusses  the  work  accomplished  during  Project  In- 
spect, Phase  II. 

The  work  is  generally  discussed  in  the  order  of  occurrence,  i.e., 
data  collection  planning,  data  management  system  development, 
field  orientation,  inspection  system  phase-in,  field  test  moni- 
toring and  reporting,  field  data  formatting,  data  reduction  and 
analysis,  MAVIS  validation  and  input  refinement,  MAVIS  Model  im- 
provements, checklist  update,  and  the  overall  results  of  the 
phased  inspection  system  implementation  and  field  evaluation. 
Finally,  conclusions  and  recommendations  are  given  which  indicate 
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the  solution  to  some  of  the  problems  encountered  and  the  direc- 
tion in  which  the  authors  believe  further  Project  Inspect  activ- 
ity should  proceed. 

Project  Inspect,  Phase  II,  contributes  to  Army  knowledge  in  the 
areas  of  inspection  system  design  and  testing,  and  in  the  estab- 
lishment of  a thorough  reliability  and  inspection  data  bank  for 
the  UH-lH  aircraft.  This  report  does  not  present  the  total 
wealth  of  reliability  data  resident  in  RCA's  computer  files,  but 
it  does  provide  computer  summary  information  generated  by  the 
data  management  system.  This  includes  cumulative  processing  re- 
sults by  group  and  by  company.  Summary  computer  listings  are 
found  in  the  section  entitled  Data  Reduction  and  Analysis.  Ap- 
pendix A,  the  final  refined  UH-lH  Helicopter  Phased  Inspection 
Checklist,  is  provided  as  one  of  the  final  products  of  Phase  II 
activity. 
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DATA  COLLECTION  PLANNING 


DATA  COLLECTION  APPROACH 


Field  evaluation  of  a new  inspection  scheme  can  severely  inter- 
rupt normal  maintenance  and  interfere  with  established  mission 
aircraft  assignments.  For  that  reason,  RCA  planned  the  imple- 
mentation of  the  field  evaluation  on  the  basis  of  minimum  inter- 
ference. The  field  evaluation  plan  for  the  UH-1H  helicopter  de- 
signed and  delivered  as  part  of  Phase  I was  written  with  minimum 
interference  with  normal  Army  operations  as  one  of  its  goals. 

Army  personnel  were  to  continue  to  function  in  a data  reporting 
capacity  as  they  do  today  - within  the  TAMMS  system  and  AMC  130 
report  system  (TM  38-750  and  AR  95-33).  Normal  aircraft  utiliza- 
tion and  mission  assignments  were  not  to  be  interfered  with  (the 
25  flight-hour/aircraft/month  requirement  slightly  increased 
normal  utilization).  Use  of  contractor  field  representatives  to 
gather  data  and  to  monitor  the  test  was  used  to  improve  data  ac- 
curacy. However,  the  Army  was  required  to  record  two  new  data 
entries  that  utilized  a one-digit  (recorded  on  DA  Form  2408-13 
or  its  attached  continuation  sheet  DA  Form  2404)  and  "When  Dis- 
covered" data  (recorded  on  the  Monthly  Maintenance  Report  (MMR) , 
DA  Form  2407,  2407-1). 

RCA's  contract  called  for  assisting  in  the  field  evaluation  of 
the  Project  Inspect  inspection  checklist  and  the  validation  and 
update  of  a computer  software  model  that  analyzes  aircraft  in- 
spection systems.  Data  was  required  to  determine  if  the  new 
checklist  is  superior  to  the  old.  This  data  was  primarily  ob- 
tained from  DA  Form  1352-1.  Contract  representatives  were  to 
borrow  this  form  bimonthly,  copy  it  via  a copying  machine,  and 
forward  it  to  the  RCA  plant  for  keypunching  and  computer  evalu- 
ation analysis.  The  second  part  of  RCA's  contractural  program 
was  more  complicated.  It  required  data  collection  on  a component 
(FSN)  level.  Data  was  required  for  all  parts,  components,  sub- 
systems, systems  (identifiable  by  FSN)  when  they  were  adjusted, 
repaired,  replaced,  removed,  installed  or  cited  for  deferred 
maintenance.  This  data  is  currently  reported  on  DA  Form  2408-13 
and  DA  Form  2407.  For  the  program,  the  reporting  accuracy  uti- 
lized on  these  forms  was  of  particular  importance  and  was  to  be 
emphasized  by  participating  commanders  and  officers.  Crew  chiefs 
were  especially  important  to  the  program  due  to  their  thorough 


15 


knowledge  of  the  aircraft  and  closeness  to  the  data  reporting 
process . 

The  following  pages  define  the  new  "When  Discovered"  code  used 
and  discuss  briefly  all  DA  Forms  that  were  to  be  collected  or 
monitored  by  contract  representatives.  New  uses  for  several 
blocks  of  the  forms  are  denoted  along  with  illustrations  of  each. 

WHEN  DISCOVERED  CODES 


"When  Discovered  Data"  is  important  in  aircraft  inspection  system 
evaluations  because  it  establishes  a historical  base  for  deter- 
mining how  long  a component  will  operate  perfectly  and  how  long 
it  takes  to  deteriorate  before  it  must  be  replaced.  In  other 
words,  this  data  is  very  important  in  the  decision  of  when  to  in- 
spect the  component  in  question.  "When  Discovered  Data"  is  new 
to  the  Army  and  was  first  used  during  Project  Inspect,  Phase  II. 
Data  recording  of  this  data  is  relatively  simple.  A single-digit 
code  is  added  to  normal  data-recording  processes.  This  code  (de- 
fined in  the  following  paragraphs)  consists  of  one  numeric  char- 
acter that  indicates  when  the  need  for  a maintenance  action  was 
discovered.  The  first  two  codes  also  provide  another  new  piece 
of  data  for  the  Army.  This  is  "Abort"  information  that  was  used 
by  Project  Inspect  to  calculate  mission  and  flight  reliability. 
These  codes  were  used  when  a system,  subsystem,  component  or  part 
was  repaired  or  replaced  or  reported  to  be  defective.  Data  was 
to  be  reported  on  a daily  basis  on  the  following  two  forms: 

1.  Monthly  Maintenance  Report  - DA  Form  2407,  Block  20, 

Column  i. 

2.  Aircraft  Inspection  and  Maintenance  Record,  DA  Form 
2408-13,  Block  17. 

The  following  list  describes  the  nine  codes  used  with  simple  di- 
rections for  each  code's  applicability.  Further  direction  on  the 
use  of  the  When  Discovered  Codes  (WDC)  is  contained  in  the  Data 
Recording  Guide  found  in  Reference  1*. 


*Interim  Technical  Report,  Tasks  I-V,  Project  Inspect,  Phase  II, 
F.W.  Hohn,  B.B.  Wierenga,  et  al,  RCA  technical  report  No.  CR76- 
588-007,  Burlington,  Massachusetts,  March  1976. 


CODE 


DESCRIPTION 


1 MISSION  ABORT  - BEFORE  FLIGHT  - - This  code  is  used  when  a 
need  for  maintenance  is  discovered  by  a flight  crew  before 
flight  and  it  is  necessary  to  abort  the  mission.  This  de- 
cision is  usually  made  during  flight  crew  preflight  inspec- 
tion or  prestart  procedure/after  engine  start/run-up 
procedure. 

2 IN-FLIGHT  ABORT  - - This  code  is  used  when  a need  for 
maintenance  is  discovered  in-flight  and  it  becomes  neces- 
sary to  abort  the  mission. 

3 PREFLIGHT/ FLIGHT  READINESS  INSPECTION  (FLIGHT  CREW)  - - 
This  code  is  used  when  a need  for  maintenance  is  discovered 
by  the  flight  crew  before  flight  and/or  during  a preflight 
inspection  and  it  is  not  necessary  to  abort  the  mission. 

It  is  also  used  for  maintenance  needs  discovered  during  the 
prestart  procedure/after  engine  start/run-up  procedure  when 
the  mission  is  not  aborted. 

4 DAILY  INSPECTION  (PMD) /AFTER  FLIGHT/ BETWEEN  FLIGHTS  - - 
This  code  is  used  when  a need  for  maintenance  is  discovered 
during  a postf light/daily  inspection. 

This  code  is  also  used  when  a need  for  maintenance  is  dis- 
covered after  completion  of  a flight  or  between  two  flights. 
Examples  are: 

1.  A pilot,  alighting  from  an  aircraft  after  completing  a 
photo  mission,  notices  that  an  access  panel  is  missing 
from  the  tail  section. 

2.  During  a passenger  stop,  a pilot  notices  a sudden  drop 
in  fuel  pressure. 

In  addition,  this  code  is  used  when  a need  for  maintenance 
is  discovered  between  flights  by  personnel  other  than  the 
air  crew.  (Example:  A mechanic  notices  an  oil  leak  from 

an  engine  while  directing  a pilot  to  a parking  position.) 

5 TEST  FLIGHT/MOC/ IN-FLIGHT  - NO  ABORT  - - This  code  is  used 
for  all  needs  for  maintenance  discovered  during  a test 
flight  or  maintenance  operational  check  that  was  conducted 
for  the  purpose  of  testing  installed  aircraft  and  engine 
accessories  and/or  equipment  or  when  a need  for  maintenance 
is  discovered  in  flight  and  it  is  not  necessary  to  abort 
the  mission. 

6 SCHEDULED  INSPECTION  (PMP,  PHASED)  - - This  code  is  used 
when  a need  for  maintenance  is  discovered  during  a PMP  or 
Phased  Scheduled  Inspection. 
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CODE 


DESCRIPTION 


7 SPECIAL  INSPECTIONS  - - This  code  is  used  when  a need  for 

maintenance  is  discovered  during  those  inspections  pub- 
lished in  the  Organizational  Maintenance  Manual  (-20). 
Typical  of  these  inspection  conditions  are:  after  a spec- 

trometric  oil  analysis,  after  a hard  landing,  after  sudden 
stoppage,  after  main  rotor  overspeed,  after  excessive  en- 
gine torque,  whenever  an  aircraft  has  been  subjected  to  a 
compressor  stall,  after  a helicopter  is  flown  in  a loose 
grass  environment,  after  engine  overtemperature , after  en- 
gine overspeed,  after  internal  inspection  of  the  engine, 
after  engine  post-installation  inspection,  when  the  engine 
accessory  drive  gearbox  has  an  oil  pump  drive  pad  with  only 
one  lubricating  hole,  etc. 

8 ALL  OTHER  - - This  code  is  used  when  a need  for  maintenance 
is  discovered  on  systems,  subsystems,  components,  etc., 
during  acceptance  inspection,  transfer  inspection,  inspec- 
tion of  aircraft  in  storage  or  during  a scheduled  activity 
not  covered  by  Codes  1 through  7 or  9. 

9 INTERMEDIATE  SCHEDULED  INSPECTION  (PMI)  - - This  code  is 
used  when  a need  for  maintenance  is  discovered  during  a 
PMI  scheduled  inspection. 

PROJECT  INSPECT  PHASE  II  ORGANIZATION 


The  basic  organization  of  personnel  involved  in  the  field  evalua- 
tion at  Fort  Campbell  is  illustrated  in  Figure  1.  Army  activity 
under  the  command  of  the  101st.  AVN  GP  CDR  was  handled  by  the 
Project  Inspect  Project  Officer.  He  designated  a senior  Sergeant 
to  monitor  administrative  and  day-to-day  problems  involved  in  the 
implementation  and  field  test  of  the  Project  Inspect  UH-1H  check- 
list. Contract  representatives  (one  from  RCA  and  one  from  AVSCOM) 
worked  full  time  at  Fort  Campbell  during  the  implementation  and 
field  trial  period.  Their  responsibilities  were  to  brief  and 
train  participating  personnel,  gather  needed  evaluation  data,  and 
monitor  the  program's  progress.  Two  battalions  were  involved  in 
the  field  evaluation  as  illustrated  in  Figure  1.  They  were  the 
101st  AVN  BN  and  the  158th  AVN  BN.  B,  C,  and  D companies  from 
both  battalions  were  involved  in  the  test,  thus  providing  a full- 
strength  participation  of  120  UH-1H  aircraft.  Three  of  these 
companies  were  designated  as  "test"  companies  and  used  the  new 
phased  (Project  Inspect)  inspection  checklist.  The  remaining 
three  companies  were  designated  as  "control"  companies  and  used 
the  existing  intermediate/ periodic  inspection  system.  All  com- 
panies, however,  were  involved  in  more  meticulous  data  recording 
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Figure  1.  Project  Inspect  Field  Organization 


than  is  usually  required.  The  selection  of  the  test  and  control 
companies  was  important  to  the  conduct  and  outcome  of  the  field 
evaluation.  Differences  in  BN  management,  personnel  capability 
and  performance,  and  aircraft  age  and  condition  can  affect  the 
test  results.  Therefore,  the  Project  Inspect  Project  Officer  was 
called  upon  to  make  that  selection. 

Responsibilities  of  Participating  Personnel 

General  responsibilities  of  Army  commanders  and  contract  repre- 
sentatives were  as  follows: 

1.  The  Project  Inspect  project  officer  and  battalion  commanders 
of  the  101st  AVN  BN  and  158th  AVN  BN  were  responsible  for 
maintaining  a favorable  climate  for  the  field  evaluation 
program.  In  addition,  they  were  responsible  for  fully  im- 
plements ting  and  maintaining  the  use  of  Project  Inspect 
checklists  (test  companies). 

2.  The  Project  Inspect  COTR  was  responsible  for  monitoring  the 
program  and  providing  UH-1H  checklists  for  the  field 
evaluation. 

3.  Commanders  of  Companies  B,  C,  and  D of  the  101st  AVN  BN  and 
158th  AVN  BN  were  responsible  for  fully  implementing  and 
maintaining  the  use  of  Project  Inspect  checklists  (test 
companies)  and  monitoring  the  recording  of  data  as  delin- 
eated in  this  document. 

4.  The  contract  representatives  were  responsible  for  briefing 
participating  personnel,  field  test  monitoring  and  report- 
ing. 

Field  monitoring  and  reporting  included: 

a.  Coordination  with  the  Contracting  Officer,  USAAAVS  and 
other  Army  elements  including  continuous  monitoring  for 
potential  safety  problems. 

b.  Collection  of  field  data  from  all  participating  avia- 
tion companies  as  called  for  in  The  Data  Collection 
Plan. 

c.  Preliminary  data  sorting  and  recording  of  pertinent 
TAMMS  data  entries  in  a simplified  format  for  further 
reduction  and  analysis. 

d.  Continuous  monitoring  of  data  for  correctness,  validity, 
and  accuracy. 
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e.  Reporting  to  appropriate  channels  any  indications  of 
action,  inaction,  or  trends  that  might  jeopardize  the 
validity  of  the  test. 

5.  Maintenance  Officers  (AMOs)  of  Companies  B,  C,  and  D of  the 
101st  AVN  BN  and  158th  AVN  BN  were  responsible  for  the  es- 
tablishment of  continuous  contact  and  points  of  pick-up  of 
the  required  DA  forms  with  the  contract  representatives. 
They  were  also  responsible  for  assuring  correct  data  entry 
to  records  used  in  TAMMS  (TM38-750,  AR95-33)  as  amended  by 
data  collection  requirements  in  The  Data  Collection  Plan. 

DATA  GATHERING  - APPLICABLE  FORMS 


Data  gathering  by  the  contract  representatives  involved  copying 
some  forms  (representatives  were  furnished  with  a copying  machineX 
extracting  data  from  some  forms  and  monitoring  others.  The  es- 
tablishment of  a smooth  working  relationship  for  borrowing,  ex- 
tracting data,  and  reading  recorded  data  was  the  responsibility  of 
the  contract  representatives  and  the  AMO's  of  Companies  B,  C,  and 
D of  both  the  101st  AVN  BN  and  the  158th  AVN  BN. 

Forms  copied  periodically  by  the  contract  representatives  were: 

• Daily  Aircraft  Status  Record  - DA  Form  1352-1 

• Army  Aircraft  Inventory,  Status  and  Flying  Time  - DA 
Form  1352 

• Maintenance  Request  (Monthly  Maintenance  Report)  - DA  Form 
2407 . 

Forms  from  which  data  was  extracted  and  which  was  monitored  peri- 
odically are: 

• Aircraft  Inspection  and  Maintenance  Record  - DA  Form  2408- 
13 

• Historical  Record  for  Aircraft  - DA  Form  2408-15 

• Aircraft  Component  Historical  Record,  Time  Change  Items, 

DA  Form  2408-16 

• Equipment  Inspection  and  Maintenance  Worksheet  - DA  Form 
2404  (as  utilized  for  inspections  or  continuation  sheet  of 
DA  Form  2408-13) 

• Component  Removal  and  Repair/ Overhaul  Record  - DA  Form  2410 

• Uncorrected  Fault  Record  (Aircraft)  - DA  Form  2408-14 
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• Equipment  Inspection  List  (Aircraft)  - DA  Form  2408-18. 

The  following  paragraphs  explain  changes  to  data  reporting  and 
data  gathering,  form  by  form,  with  illustrations  of  those  forms 
which  were  frequently  copied  or  used  for  data  extraction. 

Daily  Aircraft  Status  Record  - DA  Form  1352-1 

This  form  was  borrowed  and  copied  every  month.  It  contains  data 
used  in  evaluating  the  new  inspection  system  versus  the  old  (in- 
termediate/periodic). Figure  2 illustrates  the  form  used  for 
daily  aircraft  status  reporting.  It  is  prepared  by  all  organiza- 
tions required  to  submit  DA  Form  1352  and  provides  daily  data  on 
aircraft  readiness  and  utilization.  The  daily  records  are  con- 
solidated at  the  end  of  the  month,  thus  providing  the  data  needed 
for  accurate  preparation  of  DA  Form  1352.  Instructions  for  use 
of  both  these  forms  are  contained  in  AR  95-33,  Army  Aircraft  In- 
ventory, Status,  and  Flying  Time  (Inventory  Management).  This 
regulation  establishes  standards  of  operational  readiness  and 
prescribes  procedures  for  reporting  data  on  inventory,  assignment, 
status,  and  operational  data  on  standard  and  nonstandard  Army 
aircraft. 

Explanations  of  the  terms  used  on  DA  Form  1352-1  are  presented 
below  as  extracted  from  AR  95-33. 

Operationally  Ready  (OR) 

The  total  number  of  hours  during  which  the  aircraft  was 
capable  of  safe  flight  and  essential  equipment  necessary 
for  performance  of  its  primary  mission(s)  was  operative  and 
ready  to  perform  the  mission(s).  The  primary  mission(s)  is 
the  mission(s)  for  which  the  aircraft  was  designed  and  as- 
signed to  the  operational  unit.  Operational  readiness 
status  will  be  measured  against  the  primary  mission(s)  and 
will  be  the  determination  of  the  commander  of  the  possess- 
ing unit/agency  in  support  of  his  required  missions.  The 
primary  mission(s)  must  correspond  to  the  design  missions 
of  the  aircraft  as  contained  in  FM  101-20  (US  Army  Aviation 
Planning  Manual). 

Reduced  Materiel  Condition  (RMC) 

The  total  number  of  hours  during  which  the  aircraft  was 
limited  in  operational  capability  as  a result  of  at  least 
one  mission  essential  subsystem  being  inoperative  for  main- 
tenance or  supply  reasons.  RMC  reporting  is  applicable 
only  when  the  Inoperative  mission  essential  subsystem(s)  is 
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authorized  by  TDA/TOE/MTOE  or  other  official  documentation. 
Within  this  criteria  RMC  will  be  reported  for  those  aircraft 
and  mission  essential  subsystems  listed  in  appendix  B.  RMC 
time  is  an  integral  part  of  OR  time  and  cannot  be  greater 
than  OR  time. 

Not  Operationally  Ready  Supply  (NORS) 

This  is  a condition  status  of  an  aircraft  that  cannot  be 
returned  to  an  OR  status,  neither  can  further  maintenance 
work  be  performed  until  the  required  item(s)  of  supply  has 
been  made  available  at  the  worksite  for  continuance  of  main- 
tenance. NORS  time  will  start  when  the  supply  demand  has 
been  made  and  the  material/component/part  that  has  been  req- 
uisitioned is  not  available,  thus  prohibiting  further  main- 
tenance (work  stoppage) . NORS  time  will  stop  when  the  item 
requisitioned  has  been  made  available  to  maintenance,  and 
productive  maintenance  work  required  to  return  the  aircraft 
to  an  operationally  ready  status  can  be  resumed. 

Not  Operationally  Ready  Maintenance  (NORM) 

The  total  number  of  hours  that  each  aircraft  is  not  opera- 
tionally ready  due  to  maintenance  (organizational,  direct, 
general,  or  depot).  These  columns  will  reflect  the  level 
of  maintenance  performed,  not  the  level  of  the  activity 
performing  the  maintenance.  An  aircraft  is  NORM  whenever 
the  current  status  symbol  is  a red  "X"  as  recorded  on  DA 
Form  2408-13  (Aircraft  Inspection  and  Maintenance  Record). 

The  intent  is  further  clarified  as  follows: 

a.  Under  normal  conditions,  an  aircraft  requiring  periodic 
inspection  will  be  carried  as  not  operationally  ready 
from  the  time  the  administrative  time  is  flown  off  the 
aircraft  and/or  the  inspection  comes  due,  until  the  in- 
spection is  completed.  When  an  aircraft  periodic  in- 
spection has  been  delayed  due  to  operational  emergencies, 
under  combat  conditions  or  conditions  of  disaster,  the 
aircraft  will  be  acceptable  as  "ready"  during  the  de- 
layed inspection  requirements  for  operational 
emergencies . ) 

b.  An  aircraft  undergoing  a special  inspection,  contingent 
upon  specific  conditions  or  incidents  such  as  hard  land- 
ings, over  speed,  or  sudden  stoppage  that  requires  an 
immediate  inspection  to  insure  further  safe  use,  will  be 
carried  as  not  operationally  ready  until  the  aircraft  is 
determined  to  be  airworthy. 
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c.  An  operationally  ready  aircraft  that  enters  inspection 
or  is  undergoing  maintenance,  other  than  specified  in 
(a)  and  (b)  above,  is  to  be  carried  in  a ready  status 
until  an  unsafe  condition  is  found  or  until  an  item  is 
removed  that  would  create  a red  "X"  condition.  The  not- 
ready  condition  exists  until  the  unsafe  condition  is 
corrected  or  the  item  is  replaced. 

Examples : 

(1)  Removing  cowling  and  inspection  plates  to  inspect 
an  aircraft  that  is  not  otherwise  a red  "X"  does 
not,  repeat  not,  make  the  aircraft  not  operation- 
ally ready  when  the  cowling  and  inspection  plates 
can  be  reinstalled  and  the  aircraft  made  flyable 
within  one  hour. 

(2)  Removing  components  such  as  controls,  pumps,  rotor 
assembly  parts,  wheels  for  magnetic,  zyglo  or  vi- 
sual inspection  or  replacement  is  not  a nonopera- 
tionally-ready  condition.  However,  this  nonopera- 
tional  time  is  to  be  measured  from  the  time  the 
component  or  part  is  removed  until  it  is  replaced, 
then  the  aircraft  is  again  considered  to  be  ready. 

Monthly  Maintenance  Report  - DA  Form  2407 

Complete  maintenance  recording  was  required  on  the  Monthly  Main- 
tenance Report  (MMR) , DA  Form  2407,  2407-1.  Full  block  20  infor- 
mation was  required  for  all  systems,  subsystems,  components,  and 
parts  whether  they  were  replaced,  adjusted,  repaired,  checked, 
removed  and  reinstalled,  removed,  installed,  tested,  etc.  The 
requirements  for  specific  Project  Inspect  required  data  entries 
are  the  same  as  those  specified  in  TM38-750,  with  the  exception 
of  the  two  changes  denoted  in  the  next  paragraph. 

Two  changes  to  the  instructions  of  the  MMR  were  used  during  Proj- 
ect Inspect,  Phase  II.  Figure  3 illustrates  the  two  changes. 

The  first  was  a request  to  leave  room  on  the  form  for  the  con- 
tract representatives  to  enter  a five-digit  code.  This  pertains 
to  Block  20,  item  d.  The  two-digit  CB  Code  is  entered  on  the 
left-hand  side  and  a vertical  line  is  drawn,  leaving  space  for  a 
five-digit  code  to  be  entered  later.  This  space  was  required  be- 
cause RCA's  inspection  computer  model  distinguishes  between  iden- 
tical components  in  the  aircraft  and  breaks  down  certain  large 
systems  with  a nomenclature  that  is  different  from  FSN  nomencla- 
ture. Consultation  with  the  crew  chiefs  by  contract  representa- 
tives was  required  on  many  of  these  entries.  The  second  change 

25 


jL 


L 


DA  , ’,?r«  2407 


Figure  3.  DA  Form  2407,  Maintenance  Request  Used  for  Reporting 
Organizational  Maintenance  Accomplishments. 
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is  the  use  of  Block  20,  item  i to  provide  the  When  Discovered 
Code.  This  code  was  to  be  entered  for  component  line  items  in 
accordance  with  the  definitions  presented  in  the  Data  Collection 
Plan.  This  entry  was  not  required  for  time  change  removal  and 
installation  actions. 

The  Work  Unit  Code  identified  on  Figure  3 is  the  simplified  code 
that  RCA  used  to  store  A/C  data  (refer  to  Reference  1).  As  the 
program  implementation  unfolded,  numerous  data  recording  problems 
and  errors  were  found.  These  problems  necessitated  a charge  in 
the  original  plan  for  collecting  DA  Form  2407  data.  It  was  found 
that  line-by-line  data  review  and  correction  was  needed.  It  was 
also  believed  that  it  would  be  a problem  for  crew  chiefs  and  data 
recording  clerks  to  select  the  correct  WUC  code  from  a pocket 
manual.  Thus,  these  tasks  fell  upon  the  field  representatives. 
They  accomplished  this  by  transcribing  all  needed  data  onto  a 
newly  designed  computer  form  for  keypunching.  This  eliminated 
data  recording  errors  and  keypunch  errors  at  the  same  time. 

Complete  maintenance  recording  on  the  MMR  was  required  for  defer- 
red maintenance,  time  change  removal  and  installation,  components/ 
parts  replaced  and  repaired  during  scheduled  inspections,  and  work 
performed  by  direct  support  personnel  (IDSM)  on  post.  The  follow- 
ing paragraphs  clarify  this  requirement;  they  are  a copy  of  the 
directions  in  the  Data  Collection  Plan  given  to  all  participating 
troops  during  the  orientation  briefings: 

Deferred  Maintenance  Items 

"Deferred  maintenance  work  is  entered  after  it  is  performed 
on  the  MMR.  However,  the  addition  of  the  When  Discovered 
Code  complicates  this  task.  This  code  must  be  a part  of  the 
paperwork  used  for  this  type  of  maintenance  to  ensure  its 
final  correct  recording  on  the  MMR.  For  example,  if  during 
a PMD,  a deferred  maintenance  requirement  is  established, 
that  requirement  with  a "When  Discovered  Code"  (WDC)  of  four 
is  recorded  on  DA  Form  2408-13.  Then,  the  deferred  work  may 
be  listed  on  DA  Form  2408-14  or  2404,  and  finally  after  it 
is  performed  on  the  MMR.  The  same  WDC  number  should  be  car- 
ried forward  on  all  intermediate  reports  or  schedules  so 
when  the  crew  chief  fills  out  the  MMR  he  will  know  the  cor- 
rect WDC  entry." 

Time  Change  Removal 

"Time  condition  units  and  components  are  normally  reported 
on  DA  Form  2410.  Project  Inspect  requires  data  recording 
for  those  same  items  on  the  MMR.  A complete  Block  20  entry 
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should  be  made  every  time  a time  condition  item  is  changed 
(Block  20,  item  i will  be  blank).  For  normal  time  change 
items  reported  on  the  MMR,  the  failure  code  803  should  be 
used.  The  man-hour  entry  should  be  the  sum  of  the  removal 
and  installation  time  (or  two  MMR  lines  may  be  used,  one 
indicating  removal,  the  other  installation)." 

Components/Parts  Worked  on  During  Scheduled  Inspections 

"Units,  components,  and  parts  that  are  worked  on  during 
scheduled  inspections  (PMD,  PMI , PMP,  Phased)  are  not  al- 
ways accorded  full  Block  20  data  recording  on  the  MMR. 
Project  Inspect  requires  full  Elock  20  information  for 
these  items  including  action  code,  failure  code,  designa- 
tion, cumulative  flying  hours,  man-hours,  FSN,  quantity, 

WDC,  and  date.  TI  inspection  time  should  be  included  in 
the  man-hour  entry  when  applicable." 

Direct  Support  MMR  Submittal 

"Integrated  Direct  Support  Maintenance  (IDSM)  actions 
should  be  included  on  the  MMR  gathered  by  the  contract 
representatives.  If  separate  MMR' s are  prepared  by  Direct 
Support  personnel  for  organizational  level  maintenance  and 
this  work  is  not  recorded  on  the  unit's  MMR,  these  DS 
2407 's  must  also  be  gathered  by  the  contract  representa- 
tives." 

Abort  Data  Recording 

"Abort  data  in  the  form  of  a WDC  code  will  be  recorded  on 
DA  Form  2408-13  (referenced  paragraph  on  this  form).  Abort 
occurrences  usually  result  in  unscheduled  maintenance.  In 
addition,  the  fault  entered  on  DA  Form  2408-13  may  not  in- 
dicate the  finally  found  defective  component.  The  component 
that  is  found  after  a troubleshooting  process  is  reported 
on  the  MMR.  This  data  entry  should  include  the  applicable 
abort  WDC  code  in  Block  20,  item  i." 

Multiple  Parts  Usage  Recording 

"Quantity  parts  usage  (same  FSN)  during  scheduled  inspec- 
tions, monthly  unscheduled  maintenance,  etc.,  will  occur. 

If  some  of  these  parts  were  found  under  different  condi- 
tions, i.e.,  different  WDC  codes  apply,  separate  Block  20 
lines  are  to  be  written  for  each  different  WDC  code." 

Aircraft  Inspection  and  Maintenance  Record,  DA  Form  2408-13 

The  Aircraft  Inspection  and  Maintenance  Record  is  used: 
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1.  To  record  detected  faults  and  the  action  taken  to  correct 
them. 

2.  To  maintain  a continuing  record  of  aircraft  flying  hours. 

3.  To  record  maintenance  and  servicing  performed. 

4.  To  indicate  when  schedule  maintenance  inspections  become 
due . 

5.  To  indicate  status  of  the  aircraft,  and  of  the  installed 
mission  essential  equipment. 

Project  Inspect  required  that  one  additional  piece  of  data  be 
added  to  this  form,  the  When  Discovered  Code  (WDC) . This  one- 
digit code  provided  the  abort  and  when  discovered  information 
gathered  by  the  contract  representatives.  It  was  recommended 
that  this  code  be  placed  in  brackets  immediately  after  the  de- 

tected fault  information  in  Block  17.  Figure  4 illustrates  the 
addition  of  this  data  for  an  inoperative  engine  turbine  tachom- 
eter. This  code  was  to  be  included  on  DA  Form  2408-13,  Block  17, 
whenever  a system,  subsystem,  component  or  part  was  recorded  to 
be  faulty  or  deficient.  Abort  information  (WDC  1,  2)  was  to  be 
recorded  when  an  abort  occurred  even  if  the  flight  crew  did  not 
know  which  component  or  part  caused  the  problem.  For  example,  a 
vibration  in  the  tail  rotor  or  tail  rotor  drive  train  could  cause 
an  abort  and  should  be  recorded  as  one.  Later  on  in  the  trouble- 
shooting and  maintenance  recording  process,  that  same  code  (WDC  1 
or  2)  must  be  recorded,  with  the  information  on  the  faulty  part 
found,  on  the  MMR. 

Historical  Record  for  Aircraft  - DA  Form  2408-15 


This  form  was  monitored  periodically  by  contract  representatives 
and  initially  copied  for  historical  data  bank  purposes. 

Aircraft  Component  Historical  Record  (Time  Change  Items)  - DA 
Form  2408-16 


This  form  was  monitored  periodically  by  contract  representatives. 

Army  Aircraft  Inventory.  Status  and  Flying  Time  - DA  Form  1352 

This  form  was  monitored  and  copied  monthly  by  the  contract  repre- 
sentatives and  was  also  copied  initially  to  provide  historical 
da  ta . 
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Equipment  Inspection  and  Maintenance  Worksheet  - DA  Form  2404 

This  form  was  monitored  periodically  by  contract  representatives 
when  utilized  for  inspection  deficiency/corrective  action  report- 
ing or  as  a continuation  sheet  to  DA  Form  2408-13. 

Component  Removal  and  Repair/Overhaul  Record  - DA  Form  2410 

This  form  was  monitored  periodically  by  contract  representatives. 
The  "man-hours  to  install"  data  entry  on  this  form  was  to  be  in- 
cluded on  the  MMR  for  Project  Inspect. 

Uncorrected  Fault  Record  (Aircraft)  - DA  Form  2408-14 

This  form  was  monitored  periodically  by  contract  representatives. 

Equipment  Inspection  List  (Aircraft)  - DA  Form  2408-18 

This  form  was  monitored  periodically  by  contract  representatives. 
The  use  of  this  form  changed  for  the  test  companies  using  the 
phased  inspection  checklist.  Former  lubrication/ servicing,  spe- 
cial inspections  and  checks  accomplished  during  the  25-hour  in- 
spection intervals  were  listed  on  this  form.  Thus,  the  use  of 
the  phased  inspection  did  not  change  the  requirement  for  special 
inspections  and  services  normally  conducted. 

HISTORICAL  DATA  GATHERING 


Historical  data  was  gathered  by  contract  representatives  during 
the  first  five  months  of  the  program.  Data  on  all  test  and  con- 
trol aircraft  was  required  to  compile  a historical  data  bank. 
Three  months  of  back  data  was  sought,  including  DA  Form  1352,  DA 
Forms  2407,  2407-1,  and  DA  Form  2408-15.  Arrangements  were  made 
by  contract  representatives  with  the  Project  Inspect  Project 
Officer  to  borrow  these  forms,  copy  them  and  send  them  to  RCA. 

SPECIAL  FORMS 


Special  forms  for  data  gathering  were  not  used  by  Army  personnel. 
However,  special  forms  were  used  by  the  field  representatives  to 
extract  and  summarize  gathered  data  and  to  submit  data  for  comput- 
er processing  at  RCA.  Three  forms  were  used  by  the  field  repre- 
sentatives to  gather  raw  data  and  to  check  if  the  status,  TBO  and 
MMR  data  was  submitted  and  reviewed  each  month.  Figures  5 through 
7 show  the  forms  providing  this  aircraft  serial  number  related 

data.  Figure  5 is  a check  form  used  to  affirm  that  the  required 
data  was  submitted/received  each  month.  Figure  6 illustrates  the 
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Figure  6.  Component  TBO  and  Inspection  Tracking  Form 
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Figure  7.  Abort/ Inspec tion  Data  Extraction  Form. 
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form  used  to  monitor  the  major  inspection  and  TBO  items  by  air- 
craft. This  form  was  used  monthly  to  determine  what  inspection 
state  each  aircraft  was  in  and  if  proper  TBO  data  and  inspection 
data  had  been  submitted  on  the  received  MMR's.  Figure  7 was  used 
to  gather  the  raw  abort  data  from  flight  line  personnel.  Both 
abort  data  and  MMR  (2407)  data  was  reviewed,  corrected,  and  trans- 
cribed onto  computer  keypunch  forms  by  the  field  representatives. 
The  forms  used  for  this  process  are  shown  in  Figures  8 and  9, 
respectively. 

In  addition  to  these  forms,  the  contract  representatives  were 
furnished  with  an  abbreviated  Work  Unit  Code  (WUC)  Manual  to  aid 
in  providing  WUC  information  to  the  copied  MMR  forms.  RCA  up- 
dated the  MAVIS  computer  inspection  model  with  Army  operational 
data  during  Project  Inspect,  Phase  II.  The  computer  model  data 
file  was  organized  by  the  WUC  system  contained  in  the  pocket 
ma  nua  1 . 

DATA  HANDLING  PROCESS 


The  data  collection/data  reporting  process  used  is  summarized  in 
block  diagram  form  on  Figure  10.  Army  personnel  were  asked  to 
fill  out  two  TAMMS  forms  slightly  different  from  those  specified 
in  TM38-750  (DA  Form  2408-13  and  DA  Form  2407).  These  forms, 
along  with  DA  Form  1352-1  and  1352,  were  duplicated  or  kept,  and 
data  was  extracted  from  them  by  contract  representatives  on  a 
monthly  basis.  Schedules  for  data  gathering/extraction  were  sug- 
gested by  the  contract  representatives  and  agreed  to  by  AMO's  in 
all  participating  aircraft  companies.  In  addition,  the  contract 
representatives  filled  in  the  special  data  required  on  the  MMR, 
performed  periodic  monitoring  of  other  TAMMS  data,  and  served  as 
liaison  between  the  101st  AVN  GP,  USAAMRDL , USAAAVS , AVSCOM,  DA 
and  RCA.  Duplicated  (1352)  and  extracted  data  (2407,  Aborts) 
were  sent  to  RCA  for  keypunching  and  computer  processing  each 
month.  Summary  processing  results  along  with  field  inputs  from 
the  contract  representatives  were  reported  to  the  Army  monthly 
in  a letter  progress  report. 
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Figure  8 . Abort  Data  Gathering  Form 
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Figure  10.  Data  Handling  Process. 


DATA  MANAGEMENT  SYSTEM  DEVELOPMENT 


INTRODUCTION  AND  SUMMARY 


Project  Inspect,  Phase  II,  required  continuous  monitoring  of  the 
status  and  progress  of  the  field  test.  This  provided  efficient 
program  control  and  adequate  coordination  between  the  many  Army 
agencies  involved.  In  view  of  the  heavy  volume  of  field  data 
that  was  processed  and  analyzed,  RCA  had  to  develop  a computer- 
ized Data  Management  System  (DMS). 

The  developed  software  package  satisfied  the  Project  Inspect 
progress/status  reporting  requirements  by  generating  monthly 
reports  directly  applicable  to  the  field  evaluation.  Computer 
outputs  were  generated  from  a data  base  that  was  expanded  monthly 
for  the  length  of  the  test  (15  months).  This  allowed  the  cumula- 
tive results  and  the  changes  in  status  to  be  viewed  on  a monthly 
basis.  Status  and  results  were  processed  and  maintained  by  air- 
craft serial  number,  by  aviation  company,  and  by  test  and  control 
aircraft  group. 

The  Data  Management  System  (DMS)  was  designed  in  a series  of  five 
computer  software  jobs: 

1.  Field  Data  Preprocessing  and  Evaluation  Criteria  Report 

2.  Cumulative  Data  Base  Update 

3.  Spares  Report 

4.  Abort  Summary  Report 

5.  MAVIS  Data  Base  Update  and  Critical  Component  Report. 

The  software  package  was  written  in  the  PL/ I computer  language  to 
run  on  an  IBM  360  computer.  Programming  was  performed  specific- 
ally to  handle  15  months  of  data,  the  length  of  the  Phase  II 
field  test.  When  all  jobs  were  run,  they  resulted  in  a series  of 
19  computer  listings.  Reference  1 describes  the  DMS  development 
effort,  the  input  data  used,  and  each  output  format  and  listing. 

A reference  chart  is  provided  on  pages  39  and  40  of  Reference  1, 
identifying  each  job  and  locating  job  module  descriptions,  ap- 
plicable flow  chart  sheets,  and  reproductions  of  computer  formats 
and  listings.  Three  appendices  are  used  in  Reference  1 to  provide 
troop  reference  data  and  DMS  component  lists.  Appendix  I is  the 
data  recording  guide  used  in  the  field  containing  DA  Form  2407 
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data  recording  examples,  a description  of  the  When  Discovered 
Codes  (WDC),  a required  data  entry  table,  and  action/ failure  code 
listings.  Appendix  II  is  a large  version  of  the  pocket  Work  Unit 
Code  Manual  used  by  the  field  representatives.  It  contains  the 
WUC  codes  upon  which  many  of  the  DMS  calculations  and  processing 
is  based.  Appendix  III  contains  a listing  of  Project  Inspect 
critical  components  and  the  reference  table  for  converting  Work 
Unit  Codes  to  the  MAVIS  Model  Master  Configuration  File  Codes. 

Although  the  Data  Management  System  produced  a great  many  evalu- 
ation criteria  results  and  processed  data  listings,  the  mainte- 
nance analysist  was  still  required  to  assess  the  processed  data. 
This  was  particularly  true  when  incremental  monthly  data  or 
changes  in  a particular  parameter  were  desired. 

DMS  DEVELOPMENT 

The  DMS  system  processed  field  data  by  aircraft  serial  number,  by 
aviation  company,  and  by  test  and  control  group.  The  DMS  system 
was  developed  in  a series  of  computational  modules  identified  in 
Figure  11.  The  modules  were  organized  into  a series  of  five  jobs 
equivalent  to  the  way  the  computer  sequenced  through  each  month's 
da  ta . 

The  DMS  system  essentially  processes  long  lists  of  aircraft 
status,  flying  time  and  maintenance  action  data.  Early  in  the 
development  process  it  was  decided  to  write  all  DMS  software 
program  in  PL/I.  This  language  was  selected  because  it  is  highly 
suited  to  the  data  processing  of  line  data,  the  prime  problem  in 
the  data  management  system.  PL/I  is  modular  and  is  a good  tool 
for  writing  programs  that  scan  characters,  manipulate  bits,  per- 
form simple  arithmetic  on  binary,  bit  string  and  decimal  data, 
and  handle  data  organized  in  lists  linked  together  by  addresses. 
It  is  believed  that  significant  savings  in  coding  resulted  from 
the  use  of  PL/I  as  this  compiler  generally  requires  fewer  state- 
ments to  solve  a given  data  processing  problem  than  does  COBOL  or 
FORTRAN . 

Figure  11  illustrates  the  major  computational  modules  in  the  DMS 
system.  They  were  used  to  process  data  on  a monthly  basis  to 
satisfy  the  progress  status  update  requirement  by  providing  the 
capability  to  generate  printed  monthly  results.  The  DMS  data 
base  expanded  as  data  from  the  field  accumulated.  This  allowed 
the  cumulative  results  and  changes  in  status  to  be  viewed  on  a 
monthly  basis.  The  following  paragraphs  provide  a description  of 
each  computational  module. 


40 


PRESENT  MONTHS 
FIELD  DATA 


Z 

i O 

§ 5 

ui  ►-  a. 

>«<s 
s < £ o 

5 o o u 


uo 

z 

o 

►— 

< 

1/)  UJ  ^ 

UJ  O < 

o 

CD 

^ ^ 

i UT  O 
wDU 

O 
— > 

U1 

z 

z o 

o t- 

u 

& 

< 

QC  ' J 

5 < 2 

uj  o’  a 

too 

D * 5? 

QC  "■ — 7 

< “ 5 
>50 
•u  o U 

JOB  1 

. - 
; _ j ui 

? 5 S 

UJ  a Z 

X 

• »—  UJ 

3?! 

« < 

<3< 
go  ° 
5^2 
t;  £ ;r 


Figure  11.  Data  Management  System  Functional  Diagram. 


Abort  Data  Computations 


An  Abort  Summary  Report  was  prepared  on  a cumulative  basis  each 
month  by  Work  Unit  Code  (WUC) . WUCs  w. re  used  to  simplify  fail- 
ure reporting  on  major  U^-IH  components.  The  summary  report 
lists  alL  in-flight,  mission  aborts,  and  related  component  fail- 
ures. The  data  reported  identified  the  abort  type,  WUC,  FSN, 
aircraft  serial  number,  and  Julian  date.  The  WUC  organized  data 
was  also  totaled  by  test  and  control  group. 

Evaluation  Criteria  Computations 

Evaluation  criteria  data  was  presented  cumulative  monthly  in  sum 
mary  form.  Among  the  data  presented  was  operational  readiness, 
not  operationally  ready  due  to  supply,  not  operationally  ready 
due  to  maintenance,  reduced  materiel  condition,  mission  reliabil 
ity,  flight  reliability,  achieved  utilization,  and  maintenance 
man-hours  per  flight-hour.  Evaluation  criteria  data  was  summari 
zed  in  four  formats: 

1.  Monthly  Evaluation  Criteria  Results  for  Aircraft  in  a 
Particular  Company. 

2.  Monthly  Evaluation  Criteria  Results  by  Company  and  Group. 

3.  MMH/FLT-HR  for  Inspection  Schemes  and  Maintenance  Actions 
by  Company  and  Group. 

4.  Quantity  of  Actions  Found  by  When  Discovered  Code  Cate- 
gorized by  Group  and  Company. 

Evaluation  criteria  calculations  were  programmed  assuming  the 
following  operational  ground  rules: 

1.  Six  aviation  companies  were  to  participate  in  the  test; 
three  "test"  companies  were  used  in  the  phased  inspection 
system,  and  three  "control"  companies  to  employ  the  stan- 
dard intermediate/periodic  inspection  system. 

2.  Twenty  UH-1H  aircraft  per  company  were  to  be  involved  in 
the  evaluation. 

3.  Aircraft  utilization  was  assumed  to  be  25  flight  hours  per 
aircraft  month. 

Safety  Control  Computations 

Extraordinary  component  replacement  rates  with  flight  critical 
subsystems  of  the  test  and  control  groups  were  flagged  by  the 
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safety  control  program.  That  program  computed  replacement  rates 
and  compared  those  rates  with  "normal"  rates  derived  from  histor- 
ical records.  Printouts  were  generated  each  month,  listing  WUC 
components  that  exhibited  a sample  of  failures  greater  than  his- 
torical statistical  limits  and  thus  suggested  further  investiga- 
tion for  the  possibility  of  potential  safety  problems. 

Spares  Usage  Computations 

The  Data  Management  System  also  processed  components  by  Federal 
Stock  Number.  As  the  2407  data  was  read  into  the  processsing 
system,  lines  with  Action  Codes  A,  S and  U (Replaced,  Installed 
or  ORF  Exchange)  were  checked  by  FSN.  A cost  table  was  checked 
to  see  if  the  component  involved  had  a value  of  $200  or  more.  If 
it  did,  the  value  was  kept  with  the  preprocessed  data.  Dollar 
values  were  not  kept  if  the  failure  code  indicated  that  it  was  a 
cannibalization  or  a no-defect  component  (Failure  Codes  674,  797- 
802).  Similarly,  computer  records  were  kept  for  time  change  com- 
ponents. On  an  aircraft  ID  basis,  the  aircraft  serial  number, 

Work  Unit  Code,  FSN,  nomenclature,  quantity  replaced,  and  total 
dollar  cost  was  accumulated  and  printed  out.  A summary  printout 
was  furnished  indicating  (by  Company  and  Test  and  Control  Group) 
the  total  quantity  replaced,  total  dollar  cost,  number  of  time 
changes,  and  total  time  change  dollar  cost. 

MAVIS  Model  Data  File  Update  Computations 

These  computations  and  processing  produced  two  computer  printouts: 

1.  Project  Inspect  MAVIS  Model  Update  File 

2.  Current  Project  Inspect  MAVIS  Master  Configuration 
File  (MCF) . 

The  update  file  lists  all  WUC  failures  by  group.  Included  on 
this  listing  are  newly  computed  values  for  deterioration  start 
rate,  Tos»  three  most  frequent  failure  codes  and  percentages, 
abort  probabilities,  MMH  per  failure,  WUC  quantity  per  aircraft, 
major  inspection  interval,  MTBF,  total  number  of  failures,  number 
of  failures  found  at  each  When  Discovered  Code  (WDC)  point, 
number  of  scheduled  and  unscheduled  failures,  scheduled  and  un- 
scheduled MMH  and  time  change  component  quantity  and  MMH  if 
applicable. 

The  Current  MAVIS  MCF  lists  field  failure  data  by  MCF  code  and 
Test  and  Control  Group  rates  per  10,000  flight  hours.  This  data 
was  computed  from  Project  Inspect  monthly  records  and  includes 
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scheduled,  unscheduled  and  total  repairs;  scheduled,  unscheduled 
and  total  MMH;  number  of  mission  and  in-flight  aborts;  and  time 
change  replacement,  and  MMH  quantities. 
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ORIENTATION  AND  INSPECTION  SYSTEM  PHASE-IN 


Orientation  and  Inspection  System  Phase-In  for  Project  Inspect 
was  used  to  orient  and  motivate  participating  personnel  at  Fort 
Campbell  and  to  phase-in  the  test  and  control  aircraft  to  the  in- 
spection and  data  collection  system.  To  accomplish  this,  one  RCA 
Service  Company  representative  and  one  AVSCOM  field  representa tive 
received  program  orientation  via  meetings  and  study  of  reports, 
etc.,  with  RCA  personnel  familiar  with  the  earlier  phases  of 
Project  Inspect.  The  field  representatives  also  aided  RCA  person- 
nel in  the  preparation  of  orientation  briefings  for  Army  person- 
nel who  would  participate  in  the  program.  Rather  than  prepare 
separate  briefings  for  officers,  flight  crews,  maintenance  per- 
sonnel, etc.,  one  complete  set  of  slides  was  prepared  for  all 
Army  personnel.  (Refer  to  Reference  1.)  This  set  of  slides  was 
also  printed  along  with  the  Data  Collection  Plan  and  furnished  to 
all  personnel.  Actual  presentation  of  the  material  was  left  to 
the  discretion  of  the  RCA  Service  Company  representative.  This 
enabled  the  material  to  be  tailored  to  the  audience  at  each  brief- 
ing and  emphasis  of  key  items  in  the  data  collection  or  inspection 
procedure.  In  addition,  field  walk-throughs  of  the  new  inspection 
checklists,  group  Army  meetings,  and  question-and-answer  periods 
were  held.  In  general,  each  participating  officer  or  troop  re- 
ceived 4 hours  of  briefing  time. 

The  orientation  and  system  phase-in  was  aided  by  the  appointment 
of  the  Project  Inspect  Project  Officer  (101st  AVN  GP  AMO).  He 
gave  introductions  and  scheduled  early  aircraft  phase-in  to  the 
new  phased  inspection  schedule.  Two  general  rules  were  employed 
for  the  aircraft  phase-in.  Starting  at  the  beginning  of  July, 
those  aircraft  with  0-25  flying  hours  since  the  last  PE  were 
placed  directly  into  the  phased  system;  those  aircraft  with  26-74 
flying  hours  were  flown  until  75  flight-hours  were  reached,  then 
a PE  was  performed  and  they  were  added  to  the  phased  system;  those 
aircraft  with  75-100  flving  hours  were  subjected  to  a PE  and  then 
added  to  the  phased  inspection  system.  Summer  operational  exer- 
cises prevented  the  phase-in  from  being  a simple  scheduled  turn- 
over. Fortunately,  the  Project  Inspect  Project  Officer  was  able 
to  work  around  this  constraint  and  evenly  phase-in  the  participa- 
ting test  aircraft.  As  of  31  July  1974,  86  percent  of  the  air- 
craft were  phased-in.  The  second  rule  followed  was  a method  to 
evenly  distribute  the  test  aircraft  among  the  eight  phased 
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inspection  intervals.  In  general,  aircraft  were  phased  into  the 
interval  with  their  same  current  numeric  PE  sequence.  Thus,  if 
the  phased  inspection  trial  was  to  be  terminated  a year  from  the 
start,  the  aircraft  could  easily  be  placed  back  into  the  same  PE 
sequence  (i.e.,  phased  inspections  are  conducted  every  100  hours 
and  increase  numerically  just  as  PE's  do).  In  addition,  special 
PE's  where  heavy  maintenance  is  performed  could  easily  be 
identified. 

Phase-in  monitoring  by  the  field  representative  supervisor  con- 
tinued until  21  August,  the  date  that  the  COTR  and  the  Project 
Inspect  Project  Officer  established  for  the  beginning  of  the 
field  evaluation.  This  activity  included  advising  maintenance 
and  operational  personnel  on  how  to  fill  out  the  maintenance 
records  required  by  the  Data  Collection  Plan,  gathering  of  back- 
data,  notification  of  data  recording  deviations,  additional 
briefings  for  new  personnel,  and  resolution  of  data  recording 
problems  such  as  cannibalization.  Field  monitoring  and  assis- 
tance by  field  representatives  continued  throughout  the  field 
evaluation  program. 

BRIEFING  PREPARATION 


This  task  called  for  the  preparation  of  briefing  material  to  be 
utilized  to  orient  all  Fort  Campbell  participating  personnel. 

This  included  commanding  and  maintenance  officers,  technical  in- 
spectors, pilots,  crew  chiefs,  mechanics,  etc.  An  audience  such 
as  this  varied  both  in  size  and  skill  and  demanded  that  the 
briefer  (RCA  field  supervisor)  tailor  his  presentation  to  his 
audience  by  both  time  and  content.  To  provide  this  capability  a 
complete  set  of  slides  (Reference  1)  was  prepared  providing  Proj- 
ect Inspect  history,  objectives,  and  the  specifics  of  the  field 
evaluation  effort.  This  gave  the  briefer  the  capability  of 
selecting  only  those  slides  that  were  required  by  a particular 
audience.  Since  some  of  the  slides  discussed  the  Data  Collection 
Plan  and  the  required  special  additions  to  the  data  recording 
process,  the  plan  itself  and  a complete  copy  of  all  slides  were 
given  to  all  participating  personnel.  A copy  of  this  material  is 
included  in  Reference  1.  The  titles  of  the  orientation  briefing 
slides  are: 

1.  Project  Inspect  Background 

2.  Analysis  of  Army  Helicopter  Inspection  Requirements 

3.  Inspection  Requirements  Analysis  Results 

4.  MAVIS-A  Tool  for  Designing  Advanced  Inspection  Systems 
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5.  Initiation  of  Project  Inspect 

6.  Project  Inspect' s Objective 

7.  Project  Inspect  Phases 

8.  Phase  I Methodology 

9.  Phase  I Safety  Control  Program 

10.  Phase  I Outputs 

11.  Project  Inspect  Phase  II 

12.  Phase  II  Schedule 

13.  Phase  II  Milestone/Task  Schedule 

14.  Aircraft  Phase-In 

15.  Project  Inspect  Organization 

16.  Monitored  Operational  Factors 

17.  Key  Phase  II  Tasks 

18.  Goals  of  Phased  Inspection  Systems 

19.  Inspection  Concept  Components 

20.  Inspection  Concepts 

21.  Project  Inspect  Phased  Inspection  Schedule 

22.  Qualitative  Comparison  Factors 

23.  PMD/PMI/PMP  Inspection  Areas 

24.  Exterior  Inspection  Areas 

25.  Interior  Inspection  Areas 

26.  Phase  Inspection  Checklist  Format 

27.  Daily  Inspection  Checklist  Format 

28.  Data  Gathering/Reduction/Reporting 

29.  Field  Representative  Responsibilities 

30.  Project  Inspect  Army  Responsibilities 

31.  When  Discovered  Codes 

32.  Data  Gathering 

33.  Project  Inspect  Data  Gathering  Changes 

34.  Historical  Back-Data  Gathering 
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Although  not  a part  of  the  formal  delivery  process,  the  Data  Col- 
lection Plan  was  an  important  part  of  the  briefing  booklet  fur- 
nished to  all  troops.  The  plan  contain  -he  words  that  "go  with" 
many  of  the  vu-graphs  and  provides  a derailed  explanation  of  the 
data  recording  process  required  by  Project  Inspect.  The  Data  Col- 
lection Plan  contains  sections  on  background  information;  Project 
Inspect;  Project  Inspect's  Objectives;  Data  Collection  Approach; 
When  Discovered  Codes;  Project  Inspect,  Phase  II,  Organization; 
and  Data  Gathering,  including  Applicable  Forms,  Historical  Data 
Gathering,  Special  Forms  and  Data  Handling  Process.  Appendices 
were  also  included  in  that  document  to  reference  aircraft  compo- 
nents requiring  maintenance  management  and  historical  data,  compo- 
nent work  unit  codes,  and  terms/definitions. 

In  addition  to  the  Project  Inspect,  Phase  II  orientation  booklet 
given  to  all  participating  troops,  a two-card  yellow  logbook  in- 
sertion was  prepared  (Figures  12  through  15),  given  to  all  crew 
chiefs,  and  added  to  all  log  books  of  the  aircraft  in  the  test 
and  control  companies.  These  cards  were  designed  to  be  a handy 
reference  for  personnel  recording  data  on  DA  Forms  2408-13  and 
2407  (Monthly  Maintenance  Report  - Organizational  and  DS1).  The 
logbook  cards  summarized  Project  Inspect  data  recording  changes, 
list  the  When  Discovered  Codes,  provide  example  filled-in  DA  2408- 
13  and  2407  forms  with  unique  Project  Inspect  requirements,  and 
explain  in  detail  the  When  Discovered  Code  definitions.  Project 
Inspect  also  had  the  requirement  to  update  the  UH-1H  computer 
data  bank  established  during  Phase  I.  This  was  accomplished  by 
using  a Work  Unit  Code  to  describe  systems,  subsystems  and  compo- 
nents aboard  the  aircraft.  Accordingly,  a Work  Unit  Code  Manual 
had  to  be  designed  and  furnished  to  the  field  representatives  for 
their  use  in  adding  this  code  to  the  Monthly  Maintenance  Reports. 
The  Work  Unit  Code  Manual  designed  is  presented  in  Appendix  II  of 
Reference  1. 

PHASE-IN  MONITORING 


Field  representatives  were  responsible  for  briefing  participating 
Army  personnel,  assisting  personnel  in  data  recording  where  neces- 
sary, and  monitoring  initial  testing  activity.  Activities  of  a 
field  test  monitoring  nature  that  were  also  applicable  to  the 
phase-in  monitoring  task  were: 

1.  Continuous  monitoring  for  potential  safety  problems. 

2.  Monitoring  of  the  testing  and  reporting  of  problems  in  in- 
spection system  implementation  and  data  collection  which 
may  jeopardize  testing  validity  to  the  Project  Inspect  Proj- 
ect Office  and  to  the  RCA  program  manager. 
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Figure  12.  Project  Inspect  Logbook  Addition,  Card  1 - Side 
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Figure  14.  Project  Inspect  Logbook  Addition,  Card  2 - Side 


TEST  FLIGHT/MOC/IN- FLIGHT  - NO  ABORT  - - This  code  is  used  for  all  needs 
discovered  during  a test  flight  or  maintenance  operational  check  which  w, 


Figure  15.  Project  Inspect  Logbook  Addition,  Card  2 - Side 
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3.  Collection  of  field  data  and  back-data  from  all  partici- 
pating aviation  companies. 

4.  Recording  of  special  TAMMS  entries  (Work  Unit  Codes)  and 
special  data  form  entries  (Abort  data). 

5.  Continuous  monitoring  of  data  for  correctness,  validity, 
and  accuracy. 

6.  Monthly  forwarding  of  data  to  the  RCA  plant,  Burlington, 
Massachusetts  for  computer  reduction  and  analysis. 

7.  Preparing  and  forwarding  monthly  activity  reports  to  the 
RCA  Program  Manager. 

8.  Providing  on-the-job  instruction  in  the  inspection  and 
data  collection  procedures  and  methods. 

9.  Reporting  to  appropriate  channels  any  indications  of 
action,  inaction,  or  trends  that  might  jeopardize  the 
validity  of  the  test. 

10.  Seeking  means  for  improving  the  inspection  procedures  and 
the  data  collection  process. 


The  RCA  field  supervisor  assisted  by  his  clerk/secretary , an  Army 
Sergeant  and  anAVSCOM  field  representative  were  responsible  for 
these  activities  throughout  the  field  evaluation  program. 

Orientation  Briefings 

Briefings  were  given  to  all  participating  Army  personnel  starting 
with  command  and  maintenance  officers  on  19  June  1974.  The 
schedule  utilized  for  the  participating  companies  was  as  follows: 


D/158  (Test) 
B/158  (Control) 
B/101  (Test) 
C/101  (Control) 
D/101  (Test) 
C/158  (Control) 


27  and  28  June  (a.m.) 

28  June  (p.m.) 

1 and  2 July 
3 July 

8 and  9 July 
10  July 


Additional  briefings  were  also  given  for  new  personnel  and  for 
personnel  away  on  leave,  or  engaged  in  operational  exercises  away 
from  Fort  Campbell.  Due  to  the  high  turnover  of  Army  personnel, 
briefings  were  given  throughout  the  field  test  evaluation  approxi- 
mately on  a bi-weekly  basis. 
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Data  Recording 


Data  Recording  for  Project  Inspect  was  highly  dependent  on  estab- 
lished TAMMS  system  data  procedures.  In  addition,  the  When  Dis- 
covered Code  (a  single-digit  number)  was  added  to  the  report 
forms  when  a system,  subsystem,  component  or  part  had  been  re- 
paired or  replaced  or  was  known  to  be  defective  or  had  caused  an 
aborted  flight  or  mission.  The  Project  Inspect  computer  program 
processed  DA  Forms  2407,  1352,  and  abort  data.  Therefore, 
throughout  the  program,  it  had  to  be  assured  that  all  coded  and 
printed  information  entered  on  the  maintenance  forms  was  accurate 
and  clearly  written  so  that  keypunch  machine  operators  could  read 
and  enter  the  information  on  punched  cards.  The  computer-processed 
data  results  were  given  to  the  Army  to  allow  assessment  of  the 
progress  and  to  validate  the  test.  Incomplete  information  fur- 
nished to  the  computer  resulted  in  rejection  of  that  particular 
line  of  data.  During  the  phase-in  monitoring  period,  the  field 
representatives  noticed  many  discrepancies  with  normal  TAMMS  re- 
porting. Errors,  omissions,  etc.,  had  to  be  reduced  through  mon- 
itoring, command  emphasis,  and  further  classroom  instruction  by 
Army  maintenance  management  personnel  and  the  field  representa- 
tives. In  some  cases,  changes  had  to  be  made  to  meet  the  re- 
quirements of  the  Data  Collection  Plan.  Data  recording  devia- 
tions noted  by  analysis  of  back  data  2407  MMR's,  work  requests 
and  other  data  forms  plus  discussions  held  at  each  company  brief- 
ing were  as  follows: 

1.  Total  man-hours  on  a PMD,  PMI  or  PMP  included  inspection 
and  maintenance  man-hours  as  recorded  on  the  2407  MMR,  but 
components  replaced  were  not  indicated.  This  was  apparent 
when  PMD  times  varied  from  2 to  9 hours. 

2.  Time  change  items  were  recorded  on  the  2410  form  but  not  on 
the  2407  form  by  all  companies. 

3.  Integrated  DS-1  support  was  accomplished  through  either  a 
2407  Work  Order  or  a verbal  request.  This  variability  made 
it  Impossible  to  track  man-hours  of  DS-1,  which  was  a part 
of  organizational  level  maintenance  (unless  the  field  rep- 
resentatives reviewed  all  2407s,  DS-1  man-hours  did  not 
generally  appear  on  the  MMR). 

4.  Removal  and  replacement  time  of  engines  was  generally  shown 
on  the  2407  Work  Order,  not  the  2407  MMR. 

5.  If  an  engine  was  transferred  from  one  aircraft  to  another, 
a 2410  form  was  made  out  (particularly  if  the  transfer  was 
to  GS  or  Depot  level  ma intenance) ; however,  the  man-hours 
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required  for  removal,  switching  and  replacing  the  engine 
may  not  have  been  recorded  on  any  DA  form.  This  should 
have  been  recorded  on  the  2407  MMR  if  performed  by  organi- 
zational personnel  or  on  the  2407  Work  Order  if  performed 
by  integrated  DS-1  personnel. 

6.  Time  change  item  work  was  performed  by  organizational  or 
DS-1  personnel.  This  data  was  entered  on  the  2408-16  and 
2410  (if  required  as  a repairable  item)  but  was  not  rec- 
orded on  the  2407  MMR  or  the  2407  Work  Order  as  required. 

7.  Many  components  replaced  on  unscheduled  maintenance  were 
not  recorded  on  the  2407  MMR.  Thus,  the  maintenance  man- 
hours for  each  company  varied  with  their  record-keeping 
technique . 

8.  2404  forms  are  used  to  indicate  failures  noted  during  an 
inspection.  Many  times  even  though  components  were  re- 
placed, there  was  not  a DA  form  showing  what  they  were. 

This  data  should  have  been  recorded  on  the  2407  MMR  or  the 
2407  Work  Order,  depending  on  who  did  the  work. 

9.  The  description  or  nomenclature  on  the  DA  Form  2407  did  not 
always  agree  with  the  FSN.  For  example,  the  rod  end  bear- 
ing that  connected  to  the  damper  assembly  might  have  been 
replaced,  but  the  FSN  for  the  damper  assembly  was  recorded 
rather  than  the  bearing. 

These  kinds  of  recording  deviations  soon  caused  a further  study 
of  the  problem  by  the  field  representatives.  It  was  found  that 
Army  personnel  commonly  had  little  or  no  training  on  the  require- 
ments of  TAMMS  as  specified  by  TM38-750.  On-the-job  training  was 
not  sufficient  to  overcome  this  wide  lack  of  knowledge.  The 
troops  involved  did  not  know  how  to  interpret  DA  Form  2407  re- 
quirements or  how  to  fill  out  the  forms.  This  caused  the  field 
representatives  to  conduct  intensive  data  recording  instructional 
classes  and  discussion  periods.  These  classes  were  held  weekly 
throughout  the  field  test.  RCA  also  produced  a Data  Recording 
Guide  (Reference  1)  which  was  used  in  the  classes  and  by  personnel 
filling  out  the  2407  forms  in  each  company. 

Phase-In  Monitoring  Completion 

In  addition  to  the  phase-in  of  the  test  aircraft  to  the  new  in- 
spection system,  phase-in  monitoring  consisted  of  determining  if 
the  new  inspections  were  performed  accurately  and  effectively  and 
if  the  data  recording  was  being  performed  by  Army  personnel  in 
accordance  with  the  Data  Collection  Plan.  On  schedule,  success- 
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ful  completion  of  these  conditions  was  thought  to  be  improbable 
in  July  1974  due  to  the  following: 

1.  Low  level  of  manning  at  Fort  Campbell.  Some  crew  chiefs 
had  to  handle  as  many  as  four  aircraft. 

2.  Fort  Hood  reported  that  2 to  3 months  were  required  for  the 
inspection  personnel  to  become  acquainted  with  the  new 
phased  inspection. 

3.  All  participating  companies  were  to  be  involved  in  opera- 
tional exercises  at  locations  other  than  Fort  Campbell  for 
most  of  the  summer  of  1974. 

4.  Data  recorded  was  in  many  cases  slightly  different  from 
TAMMS  requirements. 

5.  A substantial  turnover  of  personnel  was  anticipated. 

However,  since  the  back-data  gathering  and  the  aircraft  phase-in 
was  proceeding  smoothly,  a decision  was  made  by  the  COTR  with 
concurrence  of  the  Project  Inspect  Project  Officer  to  officially 
start  the  field  evaluation  on  21  August  1974.  This  date  consti- 
tuted the  completion  of  phase-in  monitoring.  The  largest  problem 
anticipated  was  in  the  attainment  of  uniformly  recorded  data  as 
stated  in  item  4 above.  To  aid  this  goal,  the  Army  appointed  a 
NCO  experienced  with  inspection  procedures  in  each  company  to 
monitor  the  MMRs  and  to  assist  the  field  representatives.  This 
was  to  aid  in  the  conduction  of  the  test  and  to  relieve  the  high 
workload  of  the  field  representatives. 

Checklists 

The  checklists  printed  were  developed  over  one  year  prior  to  the 
start  of  Phase  II.  Since  that  time,  change  notices  have  been 
issued  on  the  PMP  and  PMI  inspections.  These  changes  were  not 
incorporated  Into  the  phased  checklist  in  July  1974.  Addition- 
ally, changes  had  been  suggested  by  Fort  Campbell  Army  personnel 
which  would  improve  checklist  content  or  make  checklist  use 
easier  and  more  uniform  with  current  operational  practices.  All 
changes  and  suggestions  were  reviewed  by  RCA  and  KAMAN  engineer- 
ing personnel.  Items  that  were  required  or  had  high  merit  were 
approved  for  checklist  inclusion  and  given  to  the  COTR.  It  was 
recommended  that  these  changes  be  incorporated,  the  checklist  be 
retyped  horizontally  on  the  pages  (parallel  to  long  side  of  page), 
and  three  holes  punched  to  make  it  compatible  with  log-book  size 
and  format.  Additional  changes  such  as  the  provision  of  a signed 
approval  space  for  each  area  (requested  by  Army  personnel)  were 
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also  noted  at  the  time.  Solution  to  these  checklist  problems  was 
accomplished  as  follows: 

1.  Change  notice  and  checklist  errors  were  handled  immediately 
by  the  field  representatives.  They  manually  addended  sev- 
eral checklists  and  gave  them  to  the  test  companies  using 
the  phased  inspection  method. 

2.  Format  and  related  improvement/use  changes  were  held  until 
the  checklist  update  activity  was  initiated.  This  allowed 
"equivalent"  (similar)  checklists  to  be  used  and  thus  im- 
prove Test  conditions  during  the  field  evaluation. 
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FIELD  TEST  MONITORING  AND  REPORTING 


The  task  of  field  test  monitoring  and  reporting  involved  the  col- 
lection, monitoring,  transcription  and  saDmittal  of  field  data  to 
RCA  from  three  control  companies  and  three  test  companies  of  UH- 
1H  helicopters  from  the  101st  and  158th  Battalions  at  Fort  Camp- 
bell, Kentucky.  Activities  of  the  field  representative  office 
were  as  follows: 

1.  Continuous  monitoring  for  potential  safety  problems. 

2.  Monitoring  of  the  testing  and  reporting  of  problems  in 
inspection  system  implementation  and  data  collection 
that  may  jeopardize  testing  validity  to  the  Project 
Inspect  Project  Officer  and  to  the  RCA  program  manager. 

3.  Collection  of  field  data  and  back-data  from  all  partici- 
pating aviation  companies. 

4.  Recording  of  special  TAMMS  entries  (Work  Unit  Codes)  and 
special  data  form  entries  (Abort  data). 

5.  Continuous  monitoring  of  data  for  correctness,  validity, 
and  accuracy. 

6.  Monthly  forwarding  of  data  to  the  RCA  plant,  Burlington, 
Massachusetts  for  computer  reduction  and  analysis. 

7.  Preparing  and  forwarding  monthly  activity  reports  to  the 
RCA  Program  Manager. 

8.  Providing  on-the-job  instruction  in  the  inspection  and 
data  collection  procedures  and  methods. 

9.  Reporting  to  appropriate  channels  any  indications  of 
action,  inaction,  or  trends  that  might  jeopardize  the 
validity  of  the  test. 

10.  Seeking  means  for  improving  the  inspection  procedures  and 
the  data  collection  process. 

11.  Gathering  and  assessing  possible  improvements  to  the  Phased 
Inspection  Checklist. 

The  RCA  field  supervisor;  assisted  by  his  clerk/secretary,  an  Army 
Sergeant,  and  an  AVSCOM  field  representative,  was  responsible  for 
these  activities  throughout  the  field  evaluation  program. 
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This  section  covers  the  accomplishment  of  these  activities,  the 
problems  encountered,  and  how  many  of  them  were  solved.  Informa- 
tion on  data  recording,  training,  data  submitted,  field  monitor- 
ing, and  miscellaneous  problems  are  included. 

FIELD  DATA  SUBMITTED 


Data  submitted  from  Fort  Campbell  consisted  of  three  types: 

1.  Abort  Data 

2.  1352  Data,  Aircraft  Status  and  Flying  Time 

3.  2407  Data,  Organizational/Direct  Support  Monthly 
Maintenance  Accomplishments. 

The  gathering  of  these  three  data  types  and  associated  monitoring 
of  data  recording  of  forms  feeding  these  three  types  formed  the 
bulk  of  the  field  representative  work.  Every  single  line  of  the 
three  types  of  data  was  reviewed,  handchecked,  corrected  and  in 
the  majority  of  cases  transcribed  onto  computer  keypunch  forms. 

A measure  of  the  success  of  this  activity  is  the  quantity  of  data 
submitted  shown  in  Table  1.  Of  the  total  lines  submitted  each 
month,  120  lines  were  1352-type  data  and  approximately  28.5  lines 
were  abort  data.  The  remainder  of  the  lines  submitted  were  2407 
data,  monthly  maintenance  activity.  The  abort  data  was  new  to 
the  Army  and  was  used  by  Project  Inspect  to  calculate  aircraft 
mission  reliability  and  flight  reliability.  Appendix  V of  Refer- 
ence 1 demonstrates  the  success  that  Army  personnel  had  in  coping 
with  this  new  variable.  Aborts  were  noted  by  Army  personnel  on 
DA  Form  2408-13.  However,  that  form  seldom  provided  sufficient 
information  for  the  RCA  field  representative  to  complete  the 
Project  Inspect  abort  form.  Therefore,  it  was  up  to  him  to  locate 
the  individual  who  recorded  the  abort  to  determine  the  full  Proj- 
ect Inspect  data  entry. 

MAJOR  PROBLEMS  ENCOUNTERED 

A summary  of  the  problems  encountered  at  Fort  Campbell  is  pro- 
vided in  Table  2.  Most  of  the  problems  noted  are  those  peculiar 
to  the  modern  Army  and  not  in  any  way  indicative  of  subpar  per- 
formance of  the  101st  Airborne  Division.  In  fact,  the  interest 
and  cooperation  of  the  participating  forces  at  Fort  Campbell  was 
outstanding.  Reception  of  the  phased  inspection  checklist  was 
excellent  and  proves  that  this  form  of  inspection  can  easily  be 
integrated  into  the  entire  Army  aviation  fleet.  Table  2 is 
mostly  self-explanatory  as  the  problem,  noted  effect,  and  current 
status  or  problem  solution  is  given.  Some  further  notes  furnished 
by  the  RCA  field  representative  follow: 
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TABLE  2.  MAJOR  FIELD  TEST  PROBLEMS. 


Problem 

Ef fee  t 

Re  solution/ Status 

A/C  User  Funds  Short- 
age 

Higher  Downtime,  Ab- 
normal NORS  Condition 

Temporary  Problem 

Fuel  Shortage 

Low  Utilization;  In- 
creased PMD  Times, 
Number  of  Periodic 
Run-Ups,  and  Unsched- 
uled Services  Using 
Small  Parts  (gaskets, 
etc . ) 

Temporary  Problem 

Personnel  Shortage 

Maintenance  Work  Sent 
to  Higher  Level,  In- 
crease in  Major  In- 
spection Times 

Continuing 

Problem 

High  Aircraft  Turn- 
over 

Insufficient  Time  to 
Evaluate  Impact  of 
Phased  Inspection  on 
Some  Aircraft 

Typical  Operation 

High  Personnel 
, Turnover 

Requirement  for  Con- 
tinual Training,  In- 
creased Field  Repre- 
sentative Monitoring, 
Variability  in  Data 
Qual ity 

Typical  Operation 

Unnecessary  Data 
Recording  (Similar 
Entries  on  Several 
Forms) 

Extensive  Maintenance 
Time  Involved  in  Keep- 
ing Records,  Increases 
Data  Recording  Errors 

Unresolved 

Army  Personnel  Not 
Familiar  With  TM  38- 
750 

Incorrect  Data  Record- 
ing 

Continuing  Problem 
Field  Representa- 
tive Training 
Requ  ired 

Verbal  Work-Order 
Requests  Used 

Incomplete  Data 
Reporting 

Eliminated  Via 
Organizational  Up- 
dating of  Responsi- 
bilities 
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TABLE  2.  MAJOR  FIELD  TEST  PROBLEMS  (Continued) 


Problems 

Effect 

Resolution/ Status 

Collection  of  Data 
From  Remote  Exercises 

Data  Delays,  Loss  of 
Data 

New  Methods  of 
Submitting  Data 
Established 

Gathering  Data  From 
Higher  Maintenance 
Levels 

Field  Representative 
Workload  Increased, 
Additional  Training 
Required 

Interface  Estab- 
lished is  Probably 
Temporary 

Variability  in  In- 
spection "Look-Time" 
Reporting 

Inconsistent  Data 
Recording 

f 

Data  Recording 
Guide  Prepared  and 
Distributed,  In- 
creased Training 
Undertaken 

Loss  of  Data  Upon  Air- 
craft Turn-In 

Reduction  in  Data  Base 

New  Procedures  Es- 
tablished to  Re- 
trieve Data 

Inconsistent  Report- 
ing of  Service  Actions 
That  Occur  at  25  FH 
Intervals 

Data  Base  for  Sched- 
uled and  Unscheduled 
Time  Incorrect 

Service  Actions 
Added  to  Organiza- 
tional DA  Form 
2408-18,  Specified 
in  Data  Recording 
Guide 

Different  Records  of 
Some  I tens  Not  In 
Agreement  (Failure 
Codes,  FSN's,  MH) 

Incorrect  Data 
Recording 

Unresolved  - In- 
tensive Monitoring 
of  Project  Inspect 
Required  Records 
Employed 

Data  Recording  Not 
Performed  - "I  For- 
got" 

Loss  to  Data  Base 

Local  Directive 
Instituted  to  Re- 
quire Daily 
Recording 

Non-Uniform  Inspec- 
tion and  Maintenance 
Procedures  Employed 
(Due  to  Organizational 
Personnel  and  Skill 
Shortages) 

Initial  Poor  Data 
Recording 

"Work-Around" 
Procedures  Sug- 
gested and  Employ- 
ed. Additional 
Training  Used  For 
Inspec  t ion  Teams . 

1.  Shortage  of  funds  produced  an  abnormal  NORS  condition  and 
meant  a higher  downtime. 

2.  Shortage  of  fuel  meant  low  utilization,  which  in  turn, 
caused  an  increase  in  unscheduled  services,  more  mainten- 
ance on  such  components  as  seals  and  gaskets,  periodic  run- 
ups, and  longer  PMD  times. 

3.  Personnel  shortage  tends  to  first  increase  downtime  during 
a major  inspection  to  the  point  where  a Phased  Inspection 
might  have  the  same  downtime  as  a heavy  PMP,  and  second, 
cause  work  to  be  sent  outside  of  organizational  maintenance 
to  higher  levels. 

4.  The  large  turnover  of  aircraft  meant  fewer  would  stay  in 
the  phased  concept  for  the  field  evaluation  period.  As  a 
matter  of  fact,  one  or  two  aircraft  did  not  make  the  first 
100-hour  phased  inspection  interval  before  turn-in,  so  the 
data  was  of  little  value  other  than  helping  to  show  what 
components  were  replaced,  etc. 

5.  The  approximate  75  percent  turnover  of  personnel  during  the 
entire  program  necessitated  a continual  training  program  on 
data  recording;  the  loss  of  key  personnel  such  as  Technical 
Inspectior,  67  N maintenance  personnel,  company  monitors, 
and  AMO's  created  a heavy  burden  on  the  field  representa- 
tive team.  It  was  their  job  to  continually  produce  valid 
data,  achieve  uniform  data  reporting,  and  correct  mistakes 
or  omissions  on  the  2407s.  This  was  one  of  the  reasons  the 
received  data  quality  varied  from  month  to  month  throughout 
the  program.  A loss  of  trained  personnel  presents  a hard- 
ship to  any  company,  which  in  turn  affects  the  data  quality. 
Time  spent  on  records  was  always  affected,  and  this  result- 
ed in  some  nonproductive  maintenance. 

6.  Army  personnel  were  not  familiar  with  the  2407  recording 
procedures  and  other  aspects  of  TM38-750.  This  created  a 
need  for  additional  training  above  and  beyond  the  original 
plan.  This  need  was  found  before  the  Project  Inspect  eval- 
uation could  get  underway  and  continued  throughout  the  15 
months  of  the  test. 

7.  Maintenance  "work  ordered"  verbally  never  appeared  on  a 
2407,  neither  was  it  submitted  via  other  TAMMs  records. 

For  example,  specialized  maintenance  work,  Integrated  Sup- 
port (ISDM)  activity,  and  special  inspections  were  often 
requested  verbally.  Verbal  requests  resulted  in  incomplete 
data  reporting;  this  became  apparent  when  2410  and  2408-16 
component  maintenance  actions,  special  inspections,  and 
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major  inspection  action  items  were  not  recorded  on  the  2407 
form  although  they  were  indicated  on  the  2408-13s  or  2404s 
as  accomplished.  Analysis  of  eac!  umpany’s  organizational 
maintenance  structure  was  then  pursued;  recommendations 
were  given  that  were  compatible  with  the  existing  organiza- 
tions indicating  how  this  data  should  be  recorded. 

8.  Collecting  and  monitoring  the  data  on  aircraft  operating  a- 
way  from  the  local  activity  created  an  undesirable  delay  in 
transcribing  the  data  for  the  RCA  field  office.  To  prevent 
a backlog,  lines  of  communication  and  field  methods  of  sub- 
mitting data  were  established.  However,  delays  still  oc- 
curred because  many  times  the  data  was  erroneous  and  incom- 
plete. The  answers  required  could  only  be  obtained  when 
the  aircraft  logs,  records  and  personnel  returned. 

9.  The  new  requirement  to  include  data  from  direct  support 
maintenance  activity  in  addition  to  organizational  activity 
caused  an  additional  field  office  workload.  The  added  work- 
load included  copying,  monitoring,  and  data  analysis  tasks, 
training  of  direct  support  personnel,  and  distribution/ 
printing  of  orientation  and  data-recording  guides. 

10.  Inconsistencies  in  the  data  recording  of  the  "look"  times  of 
PMDs , PMIs,  PMPs , and  Phased  inspections  were  found.  Direc- 
tions on  what  could  be  lumped  under  these  inspections  and 
still  conform  to  TM38-750  had  to  be  established  and  distri- 
buted or  taught  to  Army  personnel.  Orientation  classes  and 
the  Project  Inspect  Data  Recording  Guide  were  extremely 
useful  in  establishing  a uniform  data  base.  Before  this 
situation  was  solved,  PMDs  varied  from  1.5  to  12  hours, 

PMIs  6 to  50  hours,  PMPs  80  to  700  hours  and  Phase  inspec- 
tions 40  to  300  hours. 

11.  Inconsistencies  also  occurred  in  the  reporting  of  scheduled 
and  unscheduled  man-hours.  This  happened  with  records  us- 
ing action  codes  1 and  2 or  When  Discovered  Codes  (WDCs)  7 
and  8.  The  result  was  a bias  in  the  comparison  of  scheduled 
and  unscheduled  man-hours  between  the  test  and  control  group. 
Therefore,  additional  orientation,  changes  in  methods  of 
monitoring  2407s,  and  discussions  with  individual  Army  per- 
sonnel had  to  be  employed.  When  new  personnel  became  in- 
volved in  the  reporting  cycle,  all  efforts  had  to  be 
repeated. 

12.  Loss  of  2407  data  when  an  aircraft  was  turned  in  before  the 
reporting  period  was  over  resulted  in  a loss  of  maintenance 
data  from  5 to  20  days  for  some  aircraft.  Procedures  had 
to  be  establsihed  to  retrieve  this  data  before  the  records 
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left  the  company  or  the  local  Accident  Board,  whichever  was 
the  case. 

13.  Inconsistencies  in  reporting  PMI  scheduled  services  for 
the  test  companies  occurred.  For  example,  action  code  4 
was  used  when  it  should  have  been  a 1 or  the  wrong  When 
Discovered  Code  was  used  when  for  example,  a Parts  Kit  was 
replaced.  Some  companies  also  used  the  WDC-7  when  is 
should  have  been  a WDC-3.  These  mistakes  in  recording  made 
the  data  incorrect,  as  test  companies  do  not  perform  PMI 
inspections  (action  code  4)  or  replace  components  during 
scheduled  services  as  unscheduled  man-hours  (WDC-7).  This 
was  another  problem  resolved  by  class  discussion  and  the 
Project  Inspect  Data  Recording  Guide. 

The  data  review  and  the  correction  and  analysis  process  compelled 
the  field  office  to  adopt  the  most  practical  solution  available 
as  each  problem  arose.  Their  approach  had  to  be:  What  data  is 
valid,  what  is  not?  How  do  we  correct  this  deficiency?  How  much 
time  can  we  spend  on  an  item  to  correct  the  problem  without  jeop- 
ardizing the  rest  of  the  task?  Field  monitoring  indicated  that 
valid  data  is  not  easily  obtained  without  a large  field  office 
force;  however,  constant  guidance,  working  closely  with  the  per- 
sonnel involved,  reviewing  data  before  transcription,  and  moni- 
toring records  periodically  during  the  month  solved  most  of  the 
problems.  As  Army  personnel  became  familiar  with  the  Project  In- 
spect program,  they  improved  their  recording  procedures  and  re- 
duced their  errors.  To  further  improve  the  data  collection  ac- 
curacy, however,  would  require  increased  training,  conscientious- 
ness, monitoring  and  controlled  conditions  not  practical  in  a 
typical  Army  operating  helicopter  company. 

SUGGESTIONS  FOR  ARMY  DATA  COLLECTION  IMPROVEMENT 


Considerable  time  is  spent  on  maintaining  records  such  as  the 
2408-13,  2408-16,  2408-18,  2408-15,  etc.,  plus  filling  out  canni- 
balization FC  Form  880s,  2404s,  2407s  and  2410s.  Since  many  of 
these  documents  have  similar  entries,  a consolidation  of  records 
will  ease  record-keeping  chores.  It  is  suggested  that  all  daily 
actions  be  entered  on  fewer  forms  or  logs  to  reduce  duplication. 
For  example,  the  2407  might  be  reduced  in  size  to  fit  in  the  log 
book  where  it  is  accessible  for  daily  entries.  Then,  instead  of 
being  the  rough  work  copy  at  the  end  of  the  month's  effort,  it 
will  become  the  final  copy  submitted  to  TAMMs  records.  This 
would  save  time  and  paper.  It  is  also  suggested  that  the  2407  be 
revised  to  function  in  a capacity  other  than  as  an  MMR,  MWO  entry 
or  Work  Order.  It  can  also  be  used  to  replace  the  FC  Form  880 
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(if  cannibalization  is  authorized)  and  with  modification,  the 
2404.  Constant  monitoring  of  these  records  during  the  15-month 
Project  Inspect  effort  showed  many  disagreements  between  them. 

When  the  disagreements  were  noted,  the  question  always  was  "which 
is  right"?  Reduction  of  forms  might  eliminate  this  problem.  For 
example,  a failure  code  discrepancy  often  occurred  between  the 
2410  and  2407.  Many  times  people  used  an  803  failure  code, 
merely  because  the  component  was  a time  change  item,  when  actually 
the  failure  code  should  have  been  an  020  or  a 190. 

TRAINING  PROBLEMS 


Training  was  generally  adhered  to  as  originally  planned.  Orienta- 
tion briefings  were  given  to  over  six  hundred  people.  These 
briefings  were  given  more  frequently  than  planned  to  account  for 
the  heavy  turnover  of  personnel.  The  orientation  briefings  were 
also  heavily  supplemented  by  data  recording  training  and  discus- 
sion sessions.  These  were  established  due  to  the  problems  re- 
counted in  previous  paragraphs. 

MISCELLANEOUS  FIELD  REPORTS 


Additional  tasks  were  performed  by  the  field  office  in  the  way  of 
obtaining  answers  to  specific  questions  and  analyses  in  several 
data  areas.  This  subsection  presents  information  of  that  nature, 
including  engine  repair/overhaul  cost  data  gathering,  aircraft 
turnover,  personnel  turnover,  checklist  analysis,  and  service 
ac  tions . 

Engine  Replacements/Repairs 

During  the  program  it  was  noted  that  the  engine  is  the  most  ex- 
pensive component  carried  on  the  Project  Inspect  spares  utiliza- 
tion computer  listing.  Moreover,  when  an  engine  was  replaced,  the 
full  spares  dollars  were  charged  to  that  aircraft.  This  dollar 
value  is  so  large  that  a couple  of  engines  can  easily  swing  the 
higher  total  dollar  cost  magnitude  from  control  group  to  te; 
group  and  vice  versa.  Under  the  current  recording  scheme,  an  en- 
gine could  be  removed  and  be  replaced  with  one  from  the  mainten- 
ance float.  That  same  engine  could  be  tested  by  GS,  adjusted, 
and  placed  back  into  the  float.  However,  the  actions  were  not 
tracked  and  the  data  management  system  charged  the  total  new  en- 
gine replacement  costs  against  that  aircraft.  Another  case  was 
modular  repairs  made  to  the  engine  by  DS  or  GS.  Again,  full  cost 
was  charged  against  that  aircraft.  High  time-ccnsuming  engine 
repairs  are  usually  performed  by  the  depot.  A partial  overhaul 
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or  major  module  replacement  must  cost  less  than  the  full  cost  of 
a new  engine.  Thus,  engine  spares  utilization  costs  were  probably 
overstated . 

The  field  office  attempted  to  determine  overhaul  costs  for  the 
engine.  This  was  determined  as: 

• Average  Depot  Overhaul  Cost  $13,600 

• Average  Depot  Repair  Cost  $ 7,623 

However,  when  the  RCA  field  representative  tried  to  follow  Gen- 
eral Support  2407  engine  work  orders  he  ran  into  problems.  Due 
to  the  time  delay  between  the  removal  of  the  engine  from  the  air- 
craft and  the  determination  of  the  engine  components  required  to 
make  it  serviceable,  he  was  unable  to  assign  a specific  GS  repair 
value  to  the  engine  in  the  time  frame  required  by  Project  Inspect. 

Aircraft  Turnover 


Although  aircraft  were  turned  in  occasionally  during  the  program, 
this  activity  was  particularly  heavy  during  the  last  four  months. 
During  that  time,  fourteen  aircraft  were  replaced  due  to  the  on 
condition  maintenance  (OCM)  program,  extensive  maintenance  re- 
quirements and  crash  damage.  Out  of  the  field  test  complement  of 
120  aircraft  monitored  during  the  formal  field  test,  34  were 
tumed-in.  Since  some  of  the  turned-in  aircraft  replaced  other 
turned-in  aircraft,  the  effect  on  Project  Inspect  was  not  nearly 
so  great.  Approximately  96  aircraft  were  with  the  program  long 
enough  to  average  over  15  flying-hours  per  month.  The  list  of 
aircraft  replaced  with  the  replacement  reason  follows: 
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Company  A/C  No. 


Reason 


B101 


C101 


D101 


B158 


C158 


Dl  58 


Da  te 

(Replacement)  Turned-In 


65-10048 

(68-16245) 

8/74 

OCM 

64-13861 

(73-22099) 

3/75 

Ext.  Maintenance 

71-20164 

(66-16873) 

4/75 

Deck  Separation 

73-22099 

(71-20164) 

5/75 

Fuel  Contamination 

69-15903 

(66-16450) 

9/75 

OCM 

64-13510 

(68-15382) 

2/75 

Crashed 

66-0961 

(65-10081) 

2/75 

Ext.  Maintenance 

66-16210 

(64-13592) 

4/75 

Deck  Damage 

66-16424 

(69-15350) 

10/75 

Main  Beam 

66-16411 

(66-16600) 

9/75 

Ext.  Maintenance 

68-15366 

(66-0955) 

1/75 

Crashed 

68-15382 

(67-17848) 

9/75 

OCM 

68-16333 

(68-15362) 

10/75 

Deck  Separation 

65-10105 

(67-17425) 

9/74 

Mechanical  Failure 

66-1024 

(73-21738) 

7/74 

OCM 

67-17832 

(74-22359) 

6/75 

Excessive  NORS 

68-15362 

(65-10005) 

11/74 

Accident  Damage 

68-15747 

(65-12874) 

5/75 

Compressor  Stalls 

68-16469 

(73-22099) 

9/75 

Deck  Sep. 

74-22359 

(65-10030) 

9/75 

Hit  by  DC9 

65-10005 

(71-20332) 

10/75 

Engine  Deck 

63-8828 

(65-9688) 

11/74 

Crashed 

65-9603 

(69-16719) 

7/74 

OCM 

65-9789 

(65-9682) 

10/75 

OCM 

65-10005 

(69-15017) 

8/74 

OCM 

65-10030 

(68-16250) 

8/75 

Crashed 

66-896 

(65-10105) 

10/75 

OCM 

69-16719 

(73-21806) 

11/74 

Crashed 

65-10093 

(64-13721) 

10/74 

OCM 

66-1011 

(65-9603) 

5/75 

Crashed 

68-15665 

(65-9825) 

9/74 

Unsch.  Turn-In/ 
Frame  Crack 

71-20236 

(67-17451) 

7/74 

OCM 

63-8837 

(65-9848) 

7/74 

OCM 

65-10105 

(68-15372) 

8/75 

Hard  Landing 

6c  0905 

(68-15248) 

7/74 

OCM 

66-0996 

(70-16298) 

5/75 

Cracked  Xmsn 

66-16027 

(63-8845) 

7/74 

OCM 

66-16272 

(66-16234) 

7/74 

OCM 

68-15382 

(68-16576) 

9/74 

Hard  Landing 

68-15584 

(65-10105) 

4/75 

Deck  Separation 

69-15041 

(66-935) 

8/75 

Crashed 
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Many  of  the  aircraft  turned  in  could  not  be  replaced  for  a month 
or  more.  This  meant  some  companies  did  not  have  the  full  comple- 
ment of  20  aircraft  during  some  months. 

Personnel  Turnover 


Normal  operation  within  the  Army  includes  training  and  advance- 
ment of  personnel.  Many  times  for  this  and  other  reasons,  per- 
sonnel turnover  is  high.  During  Project  Inspect  Phase  II  heavy 
personnel  changes  occurred.  The  status  of  personnel  turnover  was 
checked  twice  during  the  program  with  the  following  results: 

• May  1974  to  November  1974  - 64  Percent  Turnover 

• May  1974  to  May  1975  - 75  Percent  Turnover 

The  high  turnover  made  it  difficult  to  maintain  a smooth  data 
flow  at  times.  Key  people  who  were  trained  and  experienced  with 
the  phased  inspection  system  and  Project  Inspect' s data  collec- 
tion requirements  were  continually  replaced.  This  included  tech- 
nical inspectors,  platoon  leaders,  crew  chiefs,  data  monitors, 
ISDM  leaders,  company  AMOs,  Battalion  AMOs , and  company  COs . 
Constant  training  of  new  people  had  to  be  employed  to  make  the 
program  successful. 

Another  related  area  of  personnel  impact  was  the  under  TOE 
strength  of  many  of  the  organizations  and  in  particular,  the  lack 
of  skilled  personnel  existing  in  them.  A shortage  of  67Ns  pre- 
vailed throughout  the  entire  15  month  test  program.  Skilled  per- 
sonnel in  the  company  integrated  support  area  ISDM  was  acute  at 
times.  This  included  skilled  maintenance  men  such  as  hydraulic, 
power  train,  engine  and  rotor  specialists,  machinists  and  sheet 
metal  workers. 

Phased  Checklist  Monitoring  and  Update 

The  Project  Inspect  Phased  Inspection  Checklist  was  continually 
revised  and  kept  up  to  date.  New  changes  and  revisions  to  the 
PMI  and  PMP  as  the  result  of  Army  TWXs , etc.,  were  reviewed  and 
manually  incorporated  into  the  Phased  Inspection  Checklist.  In 
addition,  all  critical  inspection  step  TM  paragraph  references 
were  updated  to  agree  with  the  latest  manuals. 

The  tested  phased  checklist  incorporated  too  much  up  and  down 
climbing  on  the  aircraft.  For  example,  in  area  3,  step  1 the 
inspector  is  required  to  go  on  top  of  the  aircraft;  step  8 the 
side  of  the  aircraft;  and  step  12  underneath  the  aircraft. 
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Therefore,  areas?  and  steps  had  to  be  revised  during  the  checklist 
update  activity  so  that  the  inspection  could  normally  proceed  CCW 
or  CW  around  the  aircraft  with  a minimum  of  climbing. 

Along  this  same  line  of  thought,  improvements  to  the  inspection 
step  wording  were  recommended.  In  several  areas,  a panel  or  ac- 
cess plate  is  opened  to  check  only  a few  items  every  phase.  Its 
only  normal  for  an  inspector  to  look  at  everything  that  is  ex- 
posed under  that  plate  or  panel  rather  than  every  other  time  for 
example.  The  difference  in  inspection  time  is  believed  to  be  in- 
significant. In  some  cases  it  takes  only  a glance  to  check  a de- 
fect or  crack,  in  the  now  noninspected  component.  The  solution 
would  be  to  place  all  components  exposed  into  the  same  inspection 
time  interval. 

Work  was  also  performed  on  a preliminary  checklist  redesign  ef- 
fort to  improve  the  current  phased  inspection  checklist.  A re- 
organization of  inspection  areas,  inspection  steps,  and  changes 
in  instructional  wording  was  accomplished  using  a "common  sense" 
human  factors  approach.  Discussions  with  Army  Technical  Inspec- 
tors and  other  maintenance  personnel  were  of  great  assistance  in 
this  task. 

Service  Actions 


Inconsistent  reporting  of  service  actions  during  the  early  stages 
of  Project  Inspect  pointed  out  the  need  for  direction  and  a new 
method  for  keeping  track  of  the  25-hour  service  actions  that  are 
still  required  in  conjunction  with  the  phased  inspection  check- 
list. As  recommended  by  the  Data  Collection  Plan,  these  items 
were  noted  and  placed  on  the  Equipment  Inspection  List,  DA  Form 
2408-18,  carried  aboard  each  aircraft.  Figure  16  is  a copy  of 
the  Equipment  Inspection  List  required  to  be  used  with  the  new 
phased  inspection  checklist. 
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Figure  16.  Project  Inspect  Subinterval  Service  Actions. 


DATA  REDUCTION  AND  ANALYSIS 


Data  analysis  during  Project  Inspect  primarily  used  engineering 
man-hours  to  double-check  field  data,  to  correct  obvious  data 
card  inputs  to  the  Data  Management  System,  and  to  perform  monthly 
results  analysis.  Three  other  tasks  are  the  analysis  of  raw  field 
data,  monthly  data  processing,  and  MAVIS  data  base  update.  Anal- 
ysis of  raw  field  data  was  performed  by  the  field  office  at  Fort 
Campbell.  Monthly  data  processing  and  MAVIS  data  base  update 
management  system.  This  portion  of  the  report  addresses  the 
monthly  program  results  and  recounts  some  of  the  analyses  per- 
formed during  the  program.  In  particular,  comparisons  between 
the  test  group  and  the  control  group  are  addressed.  Topics  cov- 
ered include  utilization  achieved,  early  data  recording  problems, 
major  inspection  times  and  inspection  MMH/FH,  PMD  times,  OR,  NORS, 
NORM,  reliability,  WDC  differences,  and  spares  usage. 

PROJECT  INSPECT  PHASE  II  GOALS 


The  major  goals  of  the  field  evaluation  of  UH-1H  helicopter  in- 
spection systems  program  (Project  Inspect-Phase  II)  were: 

c To  Validate  the  MAVIS  Model's  Capability  to  Produce  Inspec- 
tion Schedules  and  Checklists  Which  Provide  Increased 
Operational  Readiness  at  Reduced  Cost  Without  Jeopardizing 
Aircraft  Safety. 

• To  Refine  the  MAVIS  Model  to  Improve  its  Accuracy  Based 
Upon  Field  Experience. 

• To  Refine  the  UH-1H  Phased  Inspection  Checklist  Based  on  an 
Accurate  Failure  Data  Bank  (36,000  flying  hours). 

Other  goals  included  a determination  of  the  acceptance  of  a 
phased  inspection  schedule  by  an  operational  Army  group  and  turn- 
over of  the  MAVIS  Model  to  the  Army. 

The  above  goals  are  mentioned  to  clarify  a misunderstanding  about 
the  data  gathered  during  Phase  II.  The  gathered  data  was  thought 
by  some  to  be  a controlled  experiment  such  as  a test  that  MASSTER 
might  run.  This  is  not  true.  The  data  gathering  of  Project  In- 
spect, Phase  II,  can  best  be  described  as  a sample  data  program 
gathering  a wealth  of  operational  data  including  accurate  DA  Form 


2407  (Failure)  data.  To  further  explain  this,  the  following  two 
points  are  made: 


1.  The  Project  Inspect  field  evaluation  was  not  conducted  in  a 
wholly  controlled  environment. 

Explanation:  The  field  exercises  that  the  Project  Inspect 

companies  engaged  in  during  the  program  presented  a varia- 
tion in  operational  environments.  Different  environments 
and  different  missions  heavily  impacted  spares  usage  and 
maintenance  requirements.  This  influence  was  completely 
independent  of  inspection  interval  changes.  This  influence 
caused  data  skews,  which  biased  the  comparative  computed 
spares  usage,  unscheduled  manpower,  etc. 

2.  The  Project  Inspect  monthly  summary  data  reports  were 
biased  by  inconsistent  data  recording  practices. 

Explanation:  Data  is  added  to  a cumulative  data  base  on  a 

monthly  basis.  Once  a large  quantity  of  data  has  been  en- 
tered into  the  processing  system  that  is  biased  in  one 
direction,  the  average  for  that  data  item  will  be  biased 
for  the  rest  of  the  program.  For  example,  the  PMD  times 
entered  during  the  early  months  were  recorded  as  high  values 
in  many  cases.  These  values  when  averaged  will  always  re- 
sult in  a "high"  summary  figure. 

From  the  inception  of  Project  Inspect  Phase  II  with  its  small 
field  monitoring  capability,  it  was  known  that  there  would  be  a 
limitation  in  the  data  accuracy  which  could  be  achieved.  However; 
the  data  that  was  acquired  during  the  program  is  far  superior  in 
quality  to  that  normally  fed  to  the  TAMMS  system.  It  is  believed 
that  the  failure  reporting  on  the  2407 ' s is  of  particular  high 
quality.  The  high  data  quality  provided  sufficient  basis  for 
testing  the  validity  of  the  MAVIS  model  and  refining  the  phased 
inspection  checklist. 

EARLY  DATA  RECORDING  PROBLEMS 


The  data  recording  problems  encountered  are  adequately  reported 
in  the  Field  Test  Monitoring  and  Reporting  section  of  this  re- 
port. However,  three  examples  are  again  noted  here  to  emphasize, 
in  particular,  the  adjustment  and  training  problems  that  occurred 
during  the  first  few  months  of  the  program. 

Problem  1:  In  January  1975,  it  was  reported  that  PMD's  consis- 

tently took  longer  to  do  by  the  Test  Companies  (96  percent  more 
MMH/FLT-HR) . PMD's  normally  take  about  1 to  3 hours  to  perform. 
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However,  the  data  received  indicates  that  many  of  the  PMD  inspec- 
tions took  4,  4.5,  5 and  even  8 hours.  Apparently,  there  was  a 
tendency  to  be  more  careful  during  the  daily  inspection  when  the 
inspector  knew  that  a more  thorough  inspection  would  not  be  per- 
formed for  a longer  period  of  time.  It  was  believed  that  troops 
were  accounting  for  their  total  available  time  in  the  MMR  report- 
ing process. 

Problem  2:  Several  aircraft  reported  100  percent  OR  for  the 

first  three  months  of  the  test.  A check  showed  that  some  of 
these  actually  were  not  operationally  ready  as  indicated.  After 
eliminating  maintenance  man-hours  for  all  inspections,  run-ups, 
services  and  ground  handling,  a significant  amount  of  repair  MMH 
remained.  In  other  words,  correlation  between  1352  data  and  2407 
data  was  poor. 

Problem  3:  Data  recorders  were  failing  to  report  the  major  in- 

spection "Look"  times  (Phased,  PMP , PMI  inspections).  Many  times 
repair  and  replacement  maintenance  actions  were  recorded  with 
When  Discovered  Codes  6 and  9 (these  codes  meant  that  the  need 
for  that  maintenance  action  was  discovered  during  a major  inspec- 
tion). This  indicated  to  the  field  office  reviewers  that  the  25- 
hour  service  or  inspection  and  the  100  hour  inspection  "Look" 
times  were  omitted.  This  of  course  created  problems  for  the  data 
analyzers  as  they  had  to  back  track  flying  hours  on  each  aircraft, 
go  back  to  the  company  2408-13s  for  verification,  and  check  with 
the  performing  party  to  obtain  the  time  involved. 

Problem  Solutions:  Most  of  the  data  recording  problems  were 

solved  by  continual  monitoring,  training,  and  the  use  of  discus- 
sion periods  with  all  involved  personnel.  Other  early  problems 
also  arose  due  to  the  readability  of  the  forms  and  the  lack  of 
correct  entry  on  them.  Many  corrections  were  performed  at  the 
RCA  Burlington  plant  and  many  more  were  performed  by  the  field 
representatives.  Since  keypunching  directly  from  the  2407  forms 
did  not  work,  a transcription  process  was  employed  by  the  field 
representatives.  This  process  allowed  data  entry  verification  to 
occur  on  the  spot  where  troop  referral  could  correct  many  of  the 
data  entry  problems.  Thus,  field  data  formatting  (the  transcrip- 
tion process)  was  performed  at  the  best  location  - Fort  Campbell. 
It  was  performed  by  a team  of  four,  including  one  RCA  Service 
Company  technical  representative,  one  AVSCOM  technical  representa- 
tive, one  RCA  Service  Company  clerk-typist  and  one  Army  Sergeant. 
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UTILIZATION/ FLYING- HOURS  ACCOMPLISHED 


The  utilization  or  average  flying-hours  achieved  per  aircraft,  by 
company  and  by  group  was  closely  tracked  during  the  program. 
Utilization  varied  a good  deal  more  than  desired  and  was  one  of 
the  main  reasons  causing  the  field  test  to  be  extended  from  12  to 
15  months.  Reasons  for  low  utilization  at  various  times  included 
bad  weather,  holidays,  extensive  maintenance  problems,  fuel  allo- 
cation shortage  and  funds  shortages.  Low  use  appeared  to  gener- 
ate peculiar  maintenance  problems  such  as  leaking  seals  and  gas- 
ket deterioration.  Low  use  also  causes  the  PMD  inspection  to  be- 
come far  more  thorough,  as  it  is  believed  extra  care  must  be 
taken  to  insure  adequate  safety  for  user  personnel.  Figure  17  is 
a copy  of  the  DMS  summary  results  by  company  and  group.  This 
computer  printout  shows  the  cumulative  program  average  utiliza- 
tion for  each  company  and  group.  The  numbers  listed  are  rela- 
tively close.  This  was  not  always  true  during  the  program.  The 
varied  utilization  results  obtained  can  best  be  shown  on  a month- 
by-month  basis.  Figure  18  graphically  illustrates  the  incremental 
monthly  flying  hours  accomplished  by  the  test  group  and  the  con- 
trol group.  Table  3 shows  the  same  flying  hour  achievement  but 
in  the  cumulative  monthly  form  which  was  printed  by  the  DMS  each 
month  (See  Figure  17).  Note  that  only  Figure  18  highlights  the 
monthly  differences  between  the  test  and  control  groups.  The 
areas  on  the  chart  where  the  group  goal  was  achieved  were  coinci- 
dent with  field  exercises  scheduled  by  the  101st  Airborne  Divi- 
sion. Some  of  the  "peaks  and  valleys"  on  the  graph  can  be  re- 
lated to  the  comments  provided  in  letter  progress  reports,  ex- 
cerpts of  which  follow: 

February  1975:  "Due  primarily  tr  fuel  shortages  and  fuel  con- 
tract problems,  the  allocation  of.  flying  time  is  decreasing 
sharply.  - - It  should  be  noted  that  aircraft  flying  one  or 
two  hours  per  month  is  an  abnormal  situation  and  not  one  de- 
sired by  Project  Inspect.  Not  only  are  normal  operational  con- 
ditions not  duplicated  but  aircraft  maintenance  varies  consid- 
erably. Extremely  low  use  generates  peculiar  maintenance  prob- 
lems such  as  leaking  seals  and  deterioration  of  gaskets.  Also, 
because  the  aircraft  are  seldom  used,  the  PMD  inspection  must 
become  far  more  thorough  to  insure  adequate  safety  to  user  per- 
sonnel. In  addition,  it  is  know.*  that  phased  inspection  sys- 
tems are  not  optimum  if  long  periods  of  disuse  are  anticipated. 
Evaluation  of  a new  inspection  system  then  becomes  extremely 
difficult". 
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RESULTS  FOR  REPORT  PERIOO  BEGINNING  08/2I/T4  AND  ENDING  ll/20/’75 
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figure  18.  Croup  Monthly  Flying  Hour  Accomplishment. 
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TABLE  3.  PROJECT  INSPECT  CUMULATIVE  FLYING  HOUR  SUMMARY. 
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March  1975:  --  "utilization  in  the  December-January  period  was 

abnormally  low  due  to  the  Christmas  holidays  and  bad  weather. 
Utilization  has  increased  in  the  January-February  period  but 
still  is  not  balanced  on  a company  basis".  - - - 

"Utilization  during  the  processed  data  period  was  extremely  low. 
Utilization  as  reported  resulted  in  low  aircraft  use  as  follows: 

fl 


NO.  A/C 

NO.  A/C  FLYING 

NO.  A/C 

NOT 

5 HOURS  OR 

FLYING 

COMPANY 

FLYING 

LESS 

5-10  HOURS 

B/ 101 

1 

6 

12 

D/101 

1 

5 

12 

D/158 

3 

12 

3 

C/101 

7 

4 

3 

B/158 

4 

9 

4 

C/158 

9 

10 

0 

May  1975:  "The  primary  problem  the  Project  Inspect  program  has 

is  the  past  accumulation  of  low  utilization  data  in  its  cumula- 
tive data  bank.  Low  utilization  data  is  defined  as  that  air- 
craft usage  which  is  significantly  lower  than  25  hours  per 
month.  Low  utilization  impacts  the  program  in  two  ways.  The 
first  is  the  resultant  blurring  of  the  distinguishing  features 
in  the  comparison  data  of  the  two  inspection  schemes.  The 
second  is  the  fact  that  the  test  period  will  not  be  long  enough 
(as  judged  by  earlier  field  data  sample  projections)  to  accumu- 
late sufficient  flying  hours  to  achieve  substantive  results". 


"Utilization  for  the  processed  period  was  again  low.  Many  air- 
craft were  used  less  than  ten  (10)  hours  which  is  extremely  low 
compared  with  the  goal  of  25  flying  hours  per  month.  By  company 
the  folTowing  quantity  of  aircraft  flew  ten  hours  or  less: 


Company  Quantity  of  Aircraft  with  Very  Low  Flying  Time 


B/ 101  8 
D/101  4 
D/158  4 
C/101  9 
B/158  4 
C/158  13 


"It  is  believed  the  low  utilization  for  the  last  three  months  is 
now  affecting  the  cumulative  data  results.  The  comparative 
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differences  noted  previously  are  now  in  many  cases  becoming 
less  distinguishable.  Utilization  for  all  aircraft  over  the 
last  three  months  averages  to  11.96  flying  hours  per  month. 
All  companies  are  at  least  43  percent  below  the  contractual 
goal.  The  three  month  averages  by  company  are  as  follows:  - 


Company 

Jan-Feb-Mar  Utilization  Average 

B/ 101 

14.37  flying-hours 

D/101 

14.35 

D/158 

10.53 

C/101 

12.47 

B/158 

12.78 

C/158 

7.27 

August  1975: 

"Utilization  has  improved  during  July 

companies  flew  over  500  hours.  --  It  should  be  noted  that 
Project  Inspect  is  a data  sampling  program  (data  gathered  at 
Fort  Campbell  is  a sample  of  the  total  UH-1H  fleet).  As  such 
it  is  important  to  maintain  even  usage  of  all  aircraft  in  the 
program.  This  has  not  always  occurred  due  to  field  exercise 
needs,  parts  delivery  delays,  etc.  Several  aircraft  are  well 
below  the  average  utilization  for  their  respective  company." 

Another  utilization  problem  that  occurred  and  not  shown  by  Fig- 
ure 18  was  the  imbalance  in  company  flying-hours.  This,  of 
course,  is  typical  of  Army  operational  conditions.  During  the 
middle  part  of  the  program,  some  companies  had  flown  as  much  as 
35  percent  more  hours  than  others.  This  problem  was  pointed  out 
and  Army  scheduling  reduced  the  differences  to  an  acceptable 
level  by  the  end  of  the  field  test.  The  lack  of  use  of  a couple 
of  aircraft  in  a given  company  is  also  a typical  operational 
practice.  The  need  for  parts,  parts  delivery  delays  and  canni- 
balization play  a key  role  in  this  occurrence.  Even  during  Proj- 
ject  Inspect,  when  commanding  officer  pressure  was  used  to  attempt 
to  maintain  even  usage  of  all  aircraft  in  the  program,  this 
problem/practice  was  not  completely  eliminated. 

MAJOR  INSPECTION  MMH/FH 

This  subsection  explains  some  of  the  data  recording  problems  as- 
sociated with  the  major  inspections,  discusses  the  different 
methods  used  to  accomplish  the  phased  inspection  and  presents  the 
PMI,  PMP,  Phased  inspection  data  results. 


d. 
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PMP/Phased  Data  Recording  Problems 


Data  received  on  both  inspection  types  indicated  extreme  varia- 
bility. Normally  a PMP  inspection  will  take  from  50  to  125  hours 
(Look  Time)  depending  on  the  experience  and  number  of  personnel 
involved.  However,  the  data  received  indicated  that  many  of  the 
PMP  inspections  took  175,  200,  260,  and  even  300  hours  long. 
Variable  data  was  received  from  both  direct  support  and  organiza- 
tional PE  teams. 

Discussion  of  these  times  with  the  control  companies  and  direct 
support  personnel  indicated  the  following: 

1.  There  was  a tendency  to  add  the  component  maintenance 
action  codes  A,  B,  R,  S,  L,  etc.,  to  the  PMP  "Look" 

(code  5)  time. 

2.  There  was  also  a tendency  to  account  for  all  hanger  time 
even  though  inspection  time  was  not  involved,  for  example, 
24  hours  a day. 

3.  Unscheduled  man-hour  time  such  as  services  (action  code  2) 
was  being  added  to  the  PMP  "Look"  time. 

4.  OJT  of  new  personnel  increased  the  man-hours  to  perform  the 
inspection. 

The  Phased  inspection  (action  code  5)  involved  only  the  test  com- 
panies with  their  organizational  and  integrated  support  mainten- 
ance functions  (PE  teams  and  ISDM) . A normal  Phased  inspection 
takes  from  40  to  80  hours  depending  on  the  experience  and  number 
of  personnel  involved.  However,  the  data  received  indicated 
times  varied  from  85  to  150  hours  and  sometimes  reached  the  200- 
hour  mark.  It  was  noted  that  the  inspection  personnel  had  to  be- 
come familiar  with  the  eight  phases  before  the  "Look"  times  ap- 
proached the  above  estimate.  The  overall  average  time  for  the 
phased  inspection  never  approached  the  estimated  time  for  some 
inspection  teams  in  some  of  the  companies.  This  may  have  been 
due  to  the  constant  personnel  turnover  and  individual  company 
inspection  procedures. 

Major  inspection  data  recording  problems  were  solved  for  the  most 
part  by  careful  monitoring  of  the  MMRs,  the  continual  lecturing 
and  question/answer  periods  held  on  Project  Inspect  and  data 
recording,  and  the  issue  of  the  Data  Recording  Guide. 
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Phased  Inspection  Accomplishment 


Three  test  companies  used  the  Phased  Inspection  Checklist;  each 
implemented  it  slightly  differently.  Implementation  was  based  on 
personnel  quantity  and  skill  capability  in  each  case.  The  tech- 
nical inspectors  and  crew  chiefs  accepted  and  adapted  to  the  new 
inspection  system  well.  The  three  methods  employed  were: 

1.  In  one  test  company,  the  Technical  Inspector  (T.I.)  per- 
formed all  the  steps. 

2.  In  the  second  test  company  the  T.I.  inspected  only  certain 
steps  and  the  crew  chief  the  others.  They  performed  as  a 
team;  the  T.I.  verified  all  checks  made  and  signed  off  the 
inspection  sheets.  The  T.I.'s  steps  were  circled  in  red 
for  each  area,  while  the  crew  chief's  steps  were  left 
normal.  Since  the  crew  chief  also  performs  the  PMD,  it  was 
natural  to  assume  he  could  easily  perform  the  same  steps  in 
a phased  100-hour  inspection  and  still  oversee  the  lubrica- 
tion work,  etc.  With  eight  to  eleven  crew  chiefs  and  only 
two  T.I.'s,  it  was  a good  arrangement  for  that  particular 
company.  In  this  way  the  T.I.  was  also  giving  each  crew 
chief  a good,  working  knowledge  of  the  phased  inspection 
system. 

3.  In  the  third  test  company,  a maintenance  team  performed  the 
inspection.  The  T.I.  observed  and  signed  off  the  sheets, 
noting  the  discrepancies  found. 

Major  Inspection  "Look"  Time  and  MMH/FH  Results 

Each  month  of  the  program  the  DMS  calculated  and  printed  major 
inspection  MMH/FH  by  company  and  group.  The  final  printout  for 
all  15  months  is  shown  as  Figure  19.  This  listing  contains  the 
cumulative  figures  for  the  four  inspection  types  and  for  sched- 
uled and  unscheduled  maintenance  actions.  Table  4 provides  the 
same  inspection  MMH/FH  results  but  on  a monthly  basis.  These 
were  the  cumulative  results  received  each  month  from  the  DMS  pro- 
cessing program.  These  listed  results  are  difficult  to  follow 
because  they  are  cumulative.  Monthly  incremental  results  were  ex- 
tracted from  the  data  bank  and  plotted  in  graphic  form.  This  is 
provided  in  Figure  20.  It  is  shown  that  the  Phased  inspection 
consumed  a lower  amount  of  maintenance  man-hours  per  flight-hour 
than  the  equivalent  PMP  plus  PMI  inspection.  This  amount  was  47 
percent  when  averaged  for  the  entire  15  months.  Figure  20  is 
relatively  constant  except  for  a peak  occurring  in  January  1975. 
(This  is  the  data  for  the  period  21  December  1974  through  20 
January  1975).  Reference  back  to  Figure  18  indicates  this  was  a 

82 


MM M/F L T—  Hr  fob  INSPECTION  SCHEMES  AND  MAITENANCE  ACTIONS  Br  COMPANY  *ND  Croup  PAGE  44 


3ft.  S O 
2:35  3 2 

§*5  ° • 


« * 

O ® 

o r> 


x m k 

3r  o <x 

5 * N 

Iff)  • • 

U f+  o o 


00  s 
- <x 
<x  ♦ 


® (X 

s a 


u x 9 9 
or  9 o 
Q.U®  (X  9 
Oil/)  t • 

oc«-  o o 
a 


O (V 

n o 

® <o 


5 H 

UOW) 
V* 
I O 

u - 


5 1 

I 

>■  H 

5 i 


<0  (X 

♦ - 


a.  cc  -off) 

535  8 S o 

\ua  * • • • 

r uio  o -«  - 


= ? 


cx  o 

$ * 


z 

z 

<i 

u 

CD 

o 

o 

B 

IU 

a 


j 

UJ  U) 
S UJ 

4 3 

« 4 

u > 

r -J 
z -J 

o < 


z O CO  + 
or  c o * 
u®  o o n 

iw  • • • 

- o - - 


_ r * ~ ® 

UOM  O O O 
J-  O CX 

[o  • • • 

i-  O - - 


vu» 

8Xi 


om 

y s 

03-0  — 


0 9® 
O Q ® 
O O « 


9 O 
O « 
- « 


o cx 

r>  r 


£ 5 £ 3 

r j -jo 

u!m  Q - h 8 r 

a if  trt  u z u>  u 

Ifnnuu 


■j 

u. 

■J 

4 

g 


83 


Figure  19.  MMH/FH  Program  Summary  For  Inspections. 
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Figure  20.  Monthly  Comparison  of  Test  and  Control  Group 
Major  Inspections  (MMH/FH) . 
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period  when  the  aircraft  did  not  fly  very  much  - a probable  effect 
of  the  holiday  season.  Never- the-less , this  same  effect  was 
noted  elsewhere,  i.e.,  the  PMD  inspections.  Why  do  higher  ex- 
penditures of  maintenance  man-hours  per  flight-hour  occur  during 
periods  of  low  utilization?  Two  causes  appear  to  affect  low 
utilization  data  recording  most. 

1.  Low  utilization  means  there  is  time  to  do  things  that 
could  not  be  done  before,  i.e.,  deferred  maintenance 
actions  and  unscheduled  services.  It  also  means  some  air- 
craft are  not  used  for  several  days.  These  aircraft  must 
be  activated  after  seven  days  with  periodic  run-ups. 

2.  There  is  a greater  tendency  for  personnel  to  account  for 
24  hours  a day  or  8 hours  a day  on  the  2407  maintenance 
reports . 

Major  inspection  "Look  Times"  were  also  extracted  from  the  DMS 
data  bank.  These  are  presented  in  Table  5.  The  phased  inspec- 
tion time  took  less  time  to  perform  than  the  average  PMP  did  (36 
percent  less).  However,  the  sum  of  three  PMI  times  plus  the  PMP 
time  should  be  compared  with  the  phased  time  to  be  more  accurate. 
Computed  in  this  manner,  the  phased  inspection  system  consumed  47 
percent  less  "Look  Time"  than  the  intermediate/periodic  inspec- 
tion system.  This  number  is  in  exact  agreement  with  the  pre- 
viously given  major  inspection  MMH/FH  comparison  as  over  the  en- 
tire program;  the  control  group  flew  approximately  the  same 
number  of  hours  the  test  group  flew. 

UNSCHEDULED  AND  SCHEDULED  MMH/FH  RESULTS 

Figure  19  presents  the  scheduled  and  unscheduled  MMH/FH  by  com- 
pany and  group  for  the  15-month  program.  The  numbers  listed  are 
cumulative  for  the  program.  When  totaled  together  and  compared, 
the  test  group  consumed  13  percent  less  maintenance  man-hours  per 
flight-hour  than  the  control  group.  However,  when  broken  down  we 
find  the  test  group  consuming  26.5  percent  less  scheduled  main- 
tenance but  45.2  percent  more  unscheduled  maintenance  than  the 
control  group.  The  test  group  consumed  more  unscheduled  mainten- 
ance throughout  the  program  as  is  shown  in  Table  6.  This  table 
provides  the  cumulative  results,  monthly,  as  they  occurred  during 
the  program. 

The  question  most  frequently  asked  by  personnel  being  briefed 
about  Project  Inspect  is  - "Why  was  unscheduled  maintenance 
greater  for  the  test  group  than  it  was  for  the  control  group? 
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TABLE  5.  APPROXIMATE  AVERAGE  MAJOR  INSPECTION  TIMES. 


TEST  CONTROL 


MONTH 

NO. 

FLIGHT- 

HOURS 

AVG.  PHASED 
INSPECTION 
TIME  (HRS.) 

NO. 

FLIGHT- 

HOURS 

AVG.  PMI 

TIME 

(HOURS) 

AVG  PMP 

TIME 

(HOURS) 

1 

1236 

121 

1362 

18 

170 

2 

1309 

140 

1304 

11 

266 

3 

1146 

141 

1311 

13 

167 

4 

782 

120 

931 

13 

223 

5 

344 

159 

256 

9 

537 

6 

1094 

85 

960 

12 

108 

7 

916 

164 

739 

12 

132 

8 

1654 

97 

.1156 

13 

147 

9 

1276 

119 

1263 

7 

164 

10 

2079 

100 

1770 

10 

137 

11 

1613 

53 

1570 

9 

95 

12 

1543 

91 

1611 

10 

196 

13 

1255 

76 

1244 

18 

112 

14 

1541 

84 

1509 

9 

113 

15 

1693 

91 

1875 

7 

135 

TOTALS 

19481 

102 

18861 

11.1 

160 
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TABLE  6.  PROJECT  INSPECT  CUMULATIVE  MAINTENANCE  RESULTS  (MMH/FH) . 
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Analysis  performed  during  early  MAVIS  model  work  and  during  Proj- 
ect Inspect  Phase  I indicated  that  unscheduled  maintenance  would 
be  greater  for  the  100/800  hour  phased  inspection  system  used  by 
the  test  companies  than  for  the  25/100  hour  system  used  by  the 
control  companies.  In  the  100/800  hour  system,  major  inspection 
intervals  are  increased.  If  component  failure  rates  are  constant, 
increases  in  inspection  intervals  means  that  more  failures  can 
occur  between  the  major  inspections  and  therefore  more  unscheduled 
maintenance  will  be  required.  The  extreme  case  of  opening  up  of 
inspection  intervals  would  be  the  on-condition  maintenance  situa- 
tion in  which  no  major  inspections  are  scheduled.  In  that  case 
maintenance  is  only  performed  when  a condition  requiring  mainten- 
ance is  perceived  and,  therefore,  all  maintenance  actions  are  un- 
scheduled actions. 

DAILY  INSPECTIONS  - PMDs 


The  Data  Management  System  also  kept  track  of  the  daily  inspec- 
tion or  PMD  recorded  times.  Figure  19  and  Table  4 provide  the 
cumulative  results  for  the  program.  (The  final  computer  printout 
and  tabular  listing  of  each  months  cumulative  results.)  Note  in 
both  cases  the  cumulative  test  group  PMD  times  are  significantly 
greater  than  the  control  group  PMD  times.  Why?  This  was  one  of 
the  most  frequently  asked  questions  during  the  Phase  T program. 

In  order  to  begin  to  see  the  reason  for  it,  the  cumula  ive  pro- 
cessing function  must  be  removed  from  the  data.  This  has  been 
done  and  the  result  is  shown  in  Figure  21.  Figure  21  portrays 
the  incremental  or  actual  PMD  maintenance  man-hour  per  flight- 
hour  ratio  for  each  program  month.  The  graph  shows  a great  dis- 
parity existed  during  the  first  four  months;  a sharp  peak  occur- 
red in  January  1975;  and  then  approximate  tracking  of  the  test 
and  control  groups  resulted.  The  sharp  peak  was  due  to  the  holi- 
day season,  low-utilization  period  effect  as  explained  on  page  86. 
The  large  disparity  between  the  test  and  control  group  during  the 
early  months  was  attributed  to  two  factors:  (1)  Test  company 

maintenance  personnel  were  initially  concerned  about  the  safety 
aspects  of  the  opened-up  inspection  intervals  in  the  100/800  sys- 
tem and,  therefore,  were  more  attentive  to  the  PMD,  and  (2)  Ini- 
tially the  PMD  checklist  in  the  test  group  was  a specially  pre- 
pared list  with  a 21  area  breakdown  to  correspond  with  the  21 
areas  in  the  phased  inspection  checklist.  This  proved  cumbersome 
and  after  a few  months  when  crew  chiefs  realized  that  actual 
checklist  content  was  unchanged  from  the  standard  PMD,  it  was  ef- 
fectively discarded. 

The  RCA  field  representative  reported  that  a PMD  normally  takes 
1.5  to  2.5  hours  to  perform.  However,  the  data  received  indicated 
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Figure  21.  Group  Daily  Inspection  Results  (MMH/FH). 
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that  many  of  the  PMD  inspections  took  from  4 to  8 hours  long. 

The  field  investigation  produced  the  following  additional  reasons: 

1.  Inconsistent  data  recording  occurred,  for  example,  some 
companies  combined  services  (action  codes  1 or  2)  with 
the  PMD  (code  3),  while  others  separated  these  actions. 

2.  There  was  a tendency  to  account  for  total  available  time 
during  the  day. 

3.  The  experience  level  of  the  applicable  crew  chief  and  his 
knowledge  of  his  assigned  aircraft  affected  the  time  re- 
quired to  perform  a PMD. 

4.  OJT  occurred  during  some  daily  inspections;  the  man-hours 
for  two  people  were  then  recorded  rather  than  one. 

5.  The  PMD  time  recorded  included  the  total  time  to  walk  out 
to  the  aircraft,  inspect  the  aircraft,  and  return  to  the 
hanger  area  (in  some  cases  additional  trips  for  tools 
were  included). 

The  early  PMD  data  recording  discrepancies  were  reduced  by  close 
monitoring  of  the  MMRs  prior  to  submittal,  scheduled  data  record- 
ing classes,  and  the  issuance  of  the  Project  Inspect  Data  Record- 
ing Guide. 

OPERATIONAL  READINESS 

Figure  17  presents  the  DMS  processed  results  for  Operational 
Readiness  (OR)  for  the  15-month  Phase  II  field  evaluation  program. 
OR  is  given  in  Figure  17  by  company  and  by  group  in  cumulative 
form.  Table  7 presents  the  cumulative,  results  produced  each 
month  by  the  DMS.  The  changes  of  OR  during  the  program  were  of 
considerable  interest  and  several  explanations  were  given  on  this 
variable.  These  explanations  will  be  repeated  below.  First, 
however,  the  actual  monthly  incremental  changes  are  better  iden- 
tified in  Figure  22.  It  was  expected  that  the  test  group  OR 
would  be  slightly  higher  than  the  control  group  OR  throughout  the 
program.  This  did  occur  cumulatively  as  is  illustrated  by  Table 
7.  However,  the  wide  variations  that  actually  occurred,  as  shown 
by  Figure  22,  were  not  anticipated.  The  deviations  shown  on  the 
graph  are  best  explained  as  the  result  of  operational  demands 
upon  the  101st  Airborne  Division  at  Fort  Campbell.  Some  of  these 
demands  are  noted  in  the  excerpts  from  several  letter  progress 
reports  which  follow.  The  dates  refer  to  issue  date  of  the  letter 
progress  report  and  not  the  date  shown  on  Figure  22. 
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TABLE  7.  PROJECT  INSPECT  CUMULATIVE  A/C  STATUS  RESULTS  (PERCENT). 
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Figure  22.  Group  Monthly  Operational  Readiness  Results. 
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May  1975:  "Operationally  Ready  (OR)  time  is  one  of  the  key 

operational  factors  which  will  determine  whether  the  Phased 
inspection  scheme  is  superior  to  PMP-PMI  inspection  method. 
Current  Project  Inspect  processed  results  indicate  a 3.5 
percent  advantage  in  favor  of  the  Test  Group.  This  advantage 
may  actually  be  higher  due  to  current  Army  data  recording 
conditions.  In  other  words,  true  field  test  conditions  have 
not  been  set-up  in  the  data  gathering  of  this  variable.  This 
has  occurred  because  the  Field  Data  Collection  Plan  has  been 
designed  to  offer  minimum  impact  on  Army  operation.  Neverthe- 
less, the  obvious  differences  from  true  field  test  conditions 
are  noted  as  follows.  The  field  test  essentially  is  comparing 
a phased  inspection  with  the  sum  of  intermediate  (PMI)  and 
periodic  (PMP)  inspections.  These  are  major  inspections  which 
in  general  take  one  day  or  more  to  perform.  Yet,  under  the 
rules  of  AR  95-33,  an  aircraft  requiring  a PMI  inspection  will 
be  recorded  as  operationally  ready  during  that  inspection. 
Additionally,  the  data  recording  of  1352  data  (Army  Aircraft 
Inventory,  Status,  and  Flying  Time  Data)  is  OR  goal  oriented. 
Commanding  Officers  strive  to  meet  the  goal  and  the  troops  know 
this.  Furthermore,  it  is  difficult  to  keep  track  of  every 
downtime  (or  not  available)  hour.  Sometimes  red  "X"  aircraft 
do  not  get  recorded  as  being  down.  Sometimes  lengthy  aircraft 
repair  work  (more  than  one  hour)  does  not  get  recorded  as  down- 
time. - -". 

May  1975:  "Seven  months  of  data  have  been  processed.  Several 

aircraft  are  exhibiting  unusually  low  OR  rates  or  very  high 
MMH-FH.  These  aircraft  may  be  candidates  for  the  Army  to  de- 
termine what  is  causing  the  large  data  variance.  Low  OR  rates 
are  defined  as  those  aircraft  with  less  than  50  percent  OR. 
Project  Inspect  data  shows  the  typical  aircraft  experiences 
maintenance  expeditures  of  5 MMH/FH.  Those  aircraft  with  10  or 
more  MMH/FH  are  considered  to  be  high  maintenance  users.  - -". 

December  1975:  "As  noted  in  earlier  progress  reports,  Project 

Inspect  is  not  a formal  test  with  the  aircraft  groups  performing 
exactly  the  same  missions  for  comparison  purposes.  Therefore, 
deviations  in  activity  between  the  test  and  control  group  occur 
which  are  reflected  in  the  data  gathered.  Recently,  a reversal 
in  1352  OR  data  has  occurred  - i.e.,  the  test  companies  OR  is 
now  lower  than  the  control  companies  OR.  Field  representatives 
report  that  the  annual  IG  inspections  kept  personnel  busy  and 
prevented  them  from  performing  maintenance  during  the  i4th  month. 
During  the  12th  month,  control  companies  had  built  up  a large 
backlog  of  maintenance  man-hours  which  resulted  in  a low  OR. 
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However,  this  also  caused  a reduction  in  planned  control  company 
field  exercises;  therefore,  by  the  13th  month  control  company  OR 
had  recovered  to  a higher  level." 

January  1976:  "Data  for  the  15th  month  indicates  the  test  group 

OR  rate  is  less  than  the  control  group  OR  rate.  Factors  contri- 
buting to  this  low  OR  rate  are  higher  than  usual  NORM  and/or 
NORS  as  follows: 

1.  One  test  company  utilized  only  18  aircraft  most  of  the 
period.  Extensive  DS  or  GS  maintenance  was  performed. 
Organizational  maintenance  and  NORS  were  also  high. 

Although  the  company  received  the  two  aircraft  replacements 
late  in  the  period,  they  had  to  carry  both  aircraft  for  the 
entire  period  on  the  1352  since  they  were  the  reporting 
company  for  the  period.  This  increased  the  DS  NORM. 

2.  The  second  test  company  had  12  aircraft  entered  into  phase 
inspection.  Most  of  these  aircraft  had  to  wait  for  good 
weather  to  perform  the  required  test  flight  (six  consecutive 
days  of  bad  weather  occurred).  In  addition,  two  aircraft 
had  a total  of  1259  hours  DS  on  tail  boom  and  cross  tube 
maintenance.  These  factors  caused  a high  NORM  rate. 

3.  The  third  test  company  had  satisfactory  OR  - 71  percent." 
DOWNTIME  DUE  TO  SUPPLY  (NORS) 

Figure  17  and  Table  7 present  the  DMS  cumulative  monthly  results 
for  NORS.  Cumulatively  speaking,  NORS  was  higher  for  the  control 
group  during  th  entire  program.  However,  extraction  of  NORS  data 
on  a monthly  incremental  basis  shows  a wide  data  range  for  this 
variable.  Figure  23  shows  the  wide  differences  NORS  data  gather- 
ing has  produced.  The  first  few  months  of  the  program  provided  an 
almost  doubling  of  the  NORS  value  of  the  control  group  over  the 
test  group.  This  was  sufficient  to  influence  the  cumulative  re- 
sults to  be  higher  for  the  control  group  shown  in  Table  7 for  the 
entire  program.  During  the  early  months  of  the  program  the  ques- 
tion was  asked  - "Why  are  the  test  companies  NORS  rates  lower  than 
the  control  companies  and  their  NORM  rate  higher  than  the  control 
companies?"  The  answer  given  follows: 

"When  Project  Inspect  was  initiated,  a decision  had  to  be  made  as 
to  which  companies  would  be  test  and  which  would  be  control. 

Captain  Carey,  the  101st  Aviation  Group  AMO  at  that  time,  divided 
the  companies  evenly  according  to  maintenance  skill  levels.  It  was 
determined  after  the  test  had  been  started  that  according  to  past 
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Figure  23.  Group  Monthly  NORS  Results. 
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"historical  records  these  companies  had  demonstrated  this  same 
trend  for  at  least  22  months  of  reporting  prior  to  the  start  of 
the  Project  Inspect  test. 

"The  consistent  reporting  of  higher  NORM  by  test  companies  and 
higher  NORS  by  control  companies  was  noted  early  in  the  test  and 
has  been  discussed  at  several  SAG  meetings.  Field  office  person- 
nel have  devoted  serious  effort  to  questioning  Fort  Campbell  main 
tenance  personnel  in  this  area  and  pressing  for  more  consistent 
reporting.  These  efforts  have  not  influenced  NORS/NORM  reporting 

The  RCA  field  representative  also  reported  the  following:  NORS 

data  is  directly  reported  on  DA  Form  1352  and  is  influenced  by 
several  considerations,  including: 

1.  Company  policy 

2.  Availability  problems  with  specific  components 

3.  Funds  availability 

4.  Flying  hours  recently  accomplished  (tends  to  affect  the 
number  of  maintenance  actions) 

5.  Aircraft  age  and  logged  number  of  flying  hours 

6.  The  number  of  operating  and  maintenance  errors 

7.  Selection  of  NORM  or  NORS  status  for  reporting  aircraft 
downtime. 

These  considerations  will  vary  from  month  to  month  depending  on 
the  conditions  encountered.  During  a long  field  test  such  as 
Project  Inspect  Phase  II,  only  items  1 and  7 above  should  remain 
fairly  fixed  as  they  depend  on  company  procedures. 

DOWNTIME  DUE  TO  MAINTENANCE  (NORM) 

Figure  17  and  Table  7 also  present  the  DMS  cumulative  monthly  re- 
sults for  NORM.  Cumulatively  speaking,  NORM  was  higher  for  the 
test  group  during  the  entire  program.  However,  extraction  of 
NORM  data  on  a monthly  incremental  basis  shows  some  tracking  for 
most  of  the  program.  Figure  24  presents  the  group  monthly  incre- 
mental results.  The  test  group  and  control  group  lines  cross 
each  other  at  four  points.  The  test  groups  higher  NORM  during 
months  1,4, 5, 6, 7 and  8 was  sufficient  to  produce  higher  test 
group  cumulative  results  for  the  entire  program.  The  comments 
given  in  the  previous  paragraph  (NORS  discussion)  apply  equally 
with  the  variable  NORM.  The  reader  is  referred  to  the  last  four 
paragraphs  of  the  previous  subsection. 
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Figure  24.  Group  Monthly  NORM  Results. 


RELIABILITY/SAFETY  CRITICAL  COMPONENTS 


Figure  17  and  Table  8 present  the  DMS  cumulative  monthly  results 
for  Mission  Reliability.  A slightly  higher  reliability  result 
was  produced  by  the  control  group.  This  evaluation  variable  was 
computed  using  the  number  of  preflight  aborts,  in-flight  aborts 
and  the  number  of  flights.  Abort  recording  was  newly  instituted 
into  the  Army  by  Project  Inspect.  It  is  believed  that  the  fig- 
ures are  so  close  that  no  significance  can  be  shown  by  them. 

Thus,  the  two  inspection  schedules  are  equally  effective  in  terms 
of  mission  reliability. 

The  DMS  processing  program  also  produced  a critical  component 
safety  control  listing  each  month.  Ninety  five* components  were 
checked  each  month  for  failures  and/or  adjustments  greater  than 
historical  computed  limit  values  (computed  based  on  the  number 
of  flight  hours  flowr) . Figure  25  is  the  final  listing  for  the 
critical  component  safety  control  program.  At  the  end  of  the 
program,  23  components  were  listed  for  both  the  test  group  and  the 
control  group.  Of  these,  14  components  in  the  test  group  and  9 
components  in  the  control  group  exceeded  the  historical  failure 
limit  by  more  than  100  percent.  Table  9 lists  these  components. 

A factor  of  100  percent  was  arbitrarily  chosen  to  compare  the  two 
groups  as  the  failure  numbers  are  known  to  be  slightly  high.  The 
Project  Inspect  failure  numbers  (TOTAL  FAILED  on  Figure  25)  are 
high  because  they  include  maintenance  adjustments  as  well  as  re- 
placements. Note  the  exact  agreement  of  the  control  group  com- 
ponents on  Table  9 with  the  test  group  components.  Thus,  similar 
components  in  both  groups  failed. 

WHEN  DISCOVERED  CODE  REPORTING  RESULTS 


Figure  26  presents  a brief  definition  of  the  nine  When  Discovered 
Codes  (WDC)  and  the  total  program  summary  quantity  of  maintenance 
actions  reported.  In  general,  it  can  be  seen  that  the  test  group 
reported  a greater  number  of  maintenance  actions  than  the  control 
group.  Why  did  this  occur?  This  question  and  other  questions 
explaining  the  differences  between  the  test  and  control  group  WDC 
quantity  results  were  addressed  to  the  field  office.  The  follow- 
ing lists  the  questions  and  answers  given  for  WDC  recording  and 
the  quantity  results. 

Question  1:  Why  has  the  test  group  reported  more  maintenance 

actions? 


*UH-1H  components  based  on  TB55-1500-307-25 , Aircraft  Components 
Requiring  Maintenance  Management  and  Historical  Data. 
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TABLE  8.  PROJECT  INSPECT  CUMULATIVE  RELIABILITY  RESULTS 
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Figure  25.  Critical  Component  Safety  Control  Program  Listing  (Page  1 of  6) . 
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Figure  25.  Critical  Component  Safety  Control  Program  Listing  (Page  2 of  6). 
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Figure  25  . Critical  Component  Safety  Control  Program  Listing  (Page  5 of  6) . 
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Figure  25.  Critical  Component  Safety  Control  Program  Listing  (Page  6 of  6). 


TABLE  9.  CRITICAL  COMPONENTS  EXCEEDING  HISTORICAL  FAILURE 


RATE  BY  100  PERCENT. 
TEST  GROUP 

1.  CYCLIC  SWASH/ SPT  ASSEMBLY 

2.  SYNC  ELEV  CONTROL  LINKS 

3.  MR  POWER  GRIP  ASSEMBLY 

4.  INLET  GUIDE  VANE 

5.  COMPRESSOR  HOUSING 

6.  COMPRESSOR  ROTOR  BLADE 

7.  COMBUST  CHAMBER  HOUSING 

8.  DIFFUSER 

9.  SECOND- STG  PWR  TURBINE 
ROTOR 

10.  ACCESSORY  DRIVE  GEARBOX 

11.  ENGINE  CHIP  DETECTOR 

12 . EXHAUST  THERMOCOUPLE 

13 . INTERMEDIATE  GEARBOX 

14.  T.R.  QUILL  ASSEMBLY 


CONTROL  GROUP 

1.  CYCLIC  SWASHPLATE/SPT 
ASSEMBLY 

2.  SYNC  ELEV  CONTROL  LINKS 

3.  MR  POWER  GRIP  ASSEMBLY 


4.  COMPRESSOR  ROTOR  BLADE 

5.  DIFFUSER 

6.  SECOND-STAGE  POWER  TURBINE 
ROTOR 

7.  ACCESSORY  DRIVE  GEARBOX 


8.  INTERMEDIATE  GEARBOX 

9.  T.R.  QUILL  ASSEMBLY 
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Figure  26.  WDC  Summary  Quantity  Results. 


Answer:  During  the  first  five  months  of  the  program  the  test 

group  was  more  highly  motivated  than  the  control  group.  As  a 
result  they: 

1.  Initially  recorded  a greater  quantity  of  data 

2.  Had  a greater  number  of  experienced  personnel 

3.  Maintained  great  stability  of  their  personnel  (were 
able  to  keep  their  experienced  personnel) 

4.  Flew  more  hours 

5.  Used  less  DS  personnel  to  accomplish  their  maintenance 
tasks.  (DS  personnel  initially  were  poor  data  recorders  - 
particularly  on  the  MMR,  as  their  prime  data  working/ 
recording  document  was  the  2407  Work  Order.) 

Question  2:  Why  did  the  test  group  find  a much  larger  quantity 

of  maintenance  needs  during  test  flights  than  the  control  group? 

Answer:  Maintenance  requirements  were  found  more  often  by  the 

test  group  for  many  of  the  same  reasons  expressed  in  the  answer 
to  question  1.  During  the  early  months  of  the  program  the  con- 
trol group  did  not  tend  to  indicate  that  a test  flight  was  per- 
formed when  it  was  done.  This  forced  the  data  recorder  to  in- 
dicate another  time  for  discovery  of  a maintenance  requirement. 
In  addition,  some  of  the  test  companies  had  the  policy  of 
stressing  test  flights  with  the  initiation  of  a new  and  un- 
tried inspection  system. 

Question  3:  Why  the  difference  in  WDC  code  3 recording? 

Answer:  The  test  group  total  was  higher  primarily  because  the 

test  companies  scheduled  a higher  number  MNap-of-the-Earth" 
missions.  These  missions  include  critical  flight  maneuvers 
where  the  avionic  instruments  are  of  great  importance.  Thus, 
many  of  the  maintenance  actions  detected  by  the  flight  crew 
were  related  to  the  avionic  instruments.  In  addition,  avionic 
work  is  generally  "work  ordered"  to  DS  personnel.  These  work 
orders  created  additional  action  WDC  quantities. 

Question  4:  Why  the  difference  in  WDC  code  4 recording? 

Answer:  The  test  group  recorded  a greater  quantity  of  WDC  code 

4s  due  to  their: 
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1.  Greater  thoroughness  in  performing  a PMD 

2.  Higher  RMC  condition 

3.  Higher  number  of  avionic  failures 

4.  Greater  flying  hour  accomplishment  - therefore  a higher 
number  of  PMDs  were  performed 

5.  Higher  average  age  of  their  aircraft. 

Question  5:  Why  was  WDC  7 higher  in  the  test  group? 

Answer : Initially  there  was  a recording  misunderstanding  of 

the  use  of  WDC  7.  This  code  was  not  adequately  explained  in 
the  data  collection  plan.  Initially,  the  test  group  used  WDC  7 
instead  of  WDC  8 for  scheduled  25  hour  services. 

Question  6:  Why  was  WDC  8 higher  in  the  test  group? 

Answer:  WDC  code  8 was  used  by  the  test  group  for  former  PMI 

service  actions. 

Question  7:  Why  was  WDC  code  9 used  almost  exclusively  by  the 

control  group? 

Answer:  Only  the  control  companies  performed  the  PMI  inspec- 

tion. The  phased  inspection  system  eliminated  the  formal  25- 
hour  inspection. 

Since  WDC  codes  7 and  8 were  sometimes  used  incorrectly  during 
the  initial  months  of  the  program,  a good  check  to  determine  if 
the  data  recording  was  balanced  is  to  add  together  WDC  codes  7,  8 
and  9 for  both  groups.  (WDC  code  9 must  be  added  in  the  sum  for 
the  control  group  to  account  for  some  25  hour  services  and  spe- 
cial inspections  on  the  test  group  side.)  If  we  do  this,  we  find 
relatively  close  agreement  in  the  quantity  of  maintenance  actions 
performed  by  the  two  groups. 

SPARES  USAGE 


Summary  spares  usage  for  the  entire  program  is  presented  in  Fig- 
ure 27,  while  Table  10  lists  the  cumulative  spares  usage  results 
on  a monthly  basis.  Generally,  the  spares  usage  by  the  control 
group  has  been  higher  than  the  test  group.  (Tabulated  in  the  use 
of  components  costing  $200  or  more.)  However,  this  was  not  al- 
ways true  as  is  shown  by  months  8 and  9.  This  swing  brought  sev- 
eral questions  and  analyses  during  the  program;  they  are  repeated 
below. 
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Figure  27.  Spares  Component  Utilization  Summary  Results. 
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July  1975:  "The  comparative  magnitude  of  the  "Total  $ cost" 

variable  printed  on  the  Project  Inspect  Spares  Component  Utili- 
zation Summary  has  less  significance  than  was  originally  ex- 
pected. Possible  bias  exists  in  these  numbers  due  to  U.S.  Army 
data  collection  procedures  and  assumptions  made  in  computing  the 
dollar  values.  Three  influences  known  to  affect  the  accuracy 
of  this  data  are: 

1.  Common  hardware  and  low  dollar  value  component  usage. 

2.  Engine  replacements  and  repairs. 

3.  Aircraft  replacements. 

These  items  are  discussed  in  the  paragraphs  below". 

Common  Hardware  and  Low  Dollar  Value  Component  Usage  (July  1975) 

"Common  hardware  such  as  nuts,  bolts,  fasteners,  "0"  rings,  etc. 
are  not  reported  by  the  Army  as  part  of  the  MMR  recording 
process.  In  addition,  the  data  management  system  ignores  parts 
reported  with  dollar  values  less  than  $200  from  the  spares 
usage  processing.  One  possible  impact  of  the  Project  Inspect 
program  is  the  reduction  of  maintenance  induced  failures  and 
over-inspection.  Usage  of  common  hardware  and  small  parts  is 
an  area  where  such  an  effect  will  very  likely  be  noted.  Limited 
Project  Inspect  resources  precluded  the  recovery  of  this  kind  of 
information  from  the  field.  The  RCA  field  representative  has 
recently  analyzed  NORS  items  for  both  the  test  and  control  com- 
panies for  the  period  20  September  1974  through  20  May  1975. 
These  items  were  taken  directly  from  the  1352  forms  submitted 
by  the  six  companies.  Items  listed  have  caused  an  aircraft  NORS 
condition  for  at  least  100  hours  or  more  (approximately  four 
days).  To  see  what  the  difference  in  small  parts  "out-of- 
stockage"  cases  were,  the  TBO  items  and  items  with  a dollar 
value  greater  than  $200  were  removed.  Using  this  method  the 
quantity  of  test  company  NOR  items  were  found  to  total  20  items 
while  the  control  company  totaled  94  items.  The  greater  NORS 
condition  on  the  part  of  the  control  companies  can  be  attributed 
in  part  to  the  differences  between  phased  and  intermediate/ 
periodic  inspection  systems.  The  control  companies  are  opening 
up  covers  and  removing  parts  more  often  for  inspection  purposes. 
This  has  apparently  resulted  in  greater  common  hardware  and 
small  parts  usage  by  control  group  personnel.  This  spares 
usage  difference  is  not  reflected  in  the  spares  usage  computer 
listings . " 
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Engine  Replacements/Repairs  (July  1975) 


"The  engine  is  the  most  expensive  component  carried  on  the  Proj- 
ect Inspect  spares  utilization  computer  listing  ($95,200).  When- 
ever an  engine  is  replaced  the  full  spares  dollars  are  charged  to 
that  aircraft.  This  dollar  value  is  so  large  that  a couple  of 
engines  can  easily  swing  the  high  total  dollar  cost  magnitude 
from  control  group  to  test  group  and  vice  versa.  The  Fort  Camp- 
bell field  office  does  not  have  the  manpower  or  the  capability  to 
track  engines  through  DS,  GS  and  Depot.  Under  the  current  record- 
scheme,  an  engine  can  be  removed  and  be  replaced  with  one  from 
the  maintenance  float.  That  same  engine  could  be  tested  by  GS, 
adjusted,  and  placed  back  into  the  float.  However,  the  actions 
are  not  tracked  and  the  data  management  system  charges  the  total 
new  engine  replacement  costs  against  that  aircraft.  Another  case 
is  modular  repairs  made  to  the  engine  by  DS  or  GS.  Again,  full 
cost  is  charged  against  that  aircraft.  High  time-consuming  en- 
gine repairs  are  usually  performed  by  the  depot.  A partial  over- 
haul or  major  module  replacement  must  cost  less  than  the  full  cost 
of  a new  engine.  Thus,  engine  spares  utilization  costs  are  prob- 
ably overstated  and  can  affect  the  Project  Inspect  Spares  Compon- 
ent Utilization  listings  in  an  irregular  manner." 

Aircraft  Replacements  (July  1975) 

"The  six  Project  Inspect  companies  at  Fort  Campbell  have  defined 
missions  which  require  twenty  (20)  operational  aircraft.  This 
number  of  aircraft  is  always  reported  on  the  1352  form.  Should 
one  of  the  20  aircraft  in  a company  suffer  major  damage  or  be 
transferred,  it  is  replaced  from  a float  pool.  Under  Army  regu- 
lations, all  records  go  with  the  aircraft  whether  it  be  over- 
hauled, transferred,  investigated  by  an  accident  team  or  repaired 
by  GS/ Depot.  MMR  data  gathered  in  Project  Inspect  is  lost  when- 
ever an  aircraft  is  removed  from  the  organizational  company's  re- 
sponsibility. The  peculiarities  of  the  status  report  system 
(1352  are  such  that  an  aircraft  could  be  flown  for  25-30  days  in 
a PI  company,  maintained  for  that  period  of  time  and  then  trans- 
ferred. All  the  component  failures,  flying  hours,  and  mainten- 
ance man-hours  associated  with  that  25-30  days  are  then  lost  to 
the  Project  Inspect  data  bank.  Aircraft  replacement  since  the 
beginning  of  the  field  test  has  occurred  approximately  22  times. 
The  loss  of  this  data  affects  spares  usage  data  and  other  compu- 
ter processed  Project  Inspect  data  reports  to  some  degree." 


September  1975:  "Why  has  the  cost  for  items  over  $200  been 

higher  for  control  companies  when  test  companies  have  used  more 
of  these  items?" 

"The  RCA  Monthly  Letter  Report  of  July  1975  provides  a lengthy 
discussion  of  spares  usage  dollar  value  computations  which 
should  be  referenced.  That  discussion  notes  that  the  dollar 
value  of  an  engine  is  so  large  ($95,200  or  $77,770)  that  a 
couple  of  engines  can  easily  swing  the  higher  total  dollar  cost 
magnitude  from  control  group  to  test  group  and  vice  versa.  To 
date  (20  June  1975),  the  reported  data  shows  11  engines  have 
been  replaced  by  the  test  group  and  16  by  the  control  group. 
Subtracting  the  dollar  entries  for  these  engines  provides  the 
following: 


Test  Group 
Control  Group 


Total  Quantity 
Replaced 

383 

320 


Total  Dollar 
Cost 

$455,155 

$438,902 


Average 
Dollar  Cost 

$1,188 

$1,372 


"The  differences  in  these  numbers  are  believed  to  be  caused  by 
the  varying  states  of  aircraft  age,  stress,  TBO  condition  and 
the  operational  environment  that  Project  Inspect  is  operating 
in." 


December  1975:  Components  with  High  MMH  — "A  look  at  all  the 

MMH  reported  in  the  first  13  months  led  to  the  question  - Which 
components  are  consuming  the  greatest  number  of  man-hours  for 
maintenance?  During  the  period  31,724  flying  hours  were  accumu- 
lated by  the  aircraft  in  the  six  Project  Inspect  companies. 

The  total  MMH  expended  was  153,282  hours.  The  following  com- 
ponents with  their  respective  WUC  identification  were  found  to 
be  the  high  users:" 


NO  ACTIONS 
(FAILURES+  TOTAL 


COMPONENT 

WUC  CODES 

REPAIRS+TBOs) 

MMH 

1. 

Turbine  Engine 

22000-22233 

139 

2657 

2. 

Aft  Fuselage 

1116A-B  + 

178 

1862 

Skin/ S true ture 

11161-11163  + 
11168 

3. 

Main  Starting 

22261  - 22266 

579 

1553 

Fuel  System 

(515  filters) 

4. 

Main  Rotor  Hub 

15115 

139 

1458 

5. 

Stabilizer  Bar 
Assembly 

1511 

247 

1278 

115 


} 


NO.  ACTIONS 
(FAILURES+  TOTAL 


COMPONENT 

WUC  CODES 

REPAIRS+TBOs) 

MMH 

6. 

Cyclic  Swashplate  1412B-C 
Trunnion  & Support 

187 

629 

7. 

Main  Rotor  Blade 

15114 

176 

615 

8. 

Main  Fuel  Filter 

46115 

395 

(375  TBOs) 

570 

9. 

Crew  Door 

11132  - 
11136 

348 

491 

10. 

Main  Drive  Shaft 

26111 

116 

432 

Spares  Usage  - Final  Corrected  Results 

The  computer  processed  spares  usage  results  given  on  Figure  27 
include  a bias  caused  by  the  inclusion  of  a very  high  dollar 
data  item,  the  engine.  This  bias  was  noted  and  explained  in 
the  previous  paragraph  entitled  "Engine  Replacements /Repairs". 

To  eliminate  this  bias,  all  engines  were  removed  from  the  Fig- 
ure 27  listing  data  of  components  costing  $200  or  more.  This 
data  is  presented  on  Figure  28  in  a similar  format  noting  the 
quantity  of  engines  involved.  It  is  clear  from  this  listing 
that  the  control  companies  consumed  a higher  dollar  value  of 
spares  than  the  test  companies  did.  On  a group  basis,  the  test 
companies  consumed  11  percent  more  spares  by  quantity  but  spent 
$181,298  less  than  the  control  companies  did.  The  money  differ- 
ence may  be  viewed  as  money  saved,  probably  at  least  partially 
due  to  the  implementation  of  the  new  major  inspection  system. 
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Figure  28.  Corrected  Spares  Usage  Results  (Engines  deleted) 


MAVIS  MODEL  REFINEMENT  AND  VALIDATION 


The  refinement  of  the  MAVIS  Model  was  required  to  improve  its  op- 
erating efficiency.  Test  computer  runs  of  the  model  were  also 
made  using  reduced  field  data  as  it  accumulated  into  a viable 
sample  size.  These  test  runs  were  performed  to  evaluate  the  ef- 
fect of  the  refinements  and  to  validate  the  ability  of  the  MAVIS 
to  predict  the  relative  merit  of  the  competing  inspection  con- 
cepts. All  validation  computer  runs  were  made  using  the  IBM  360/ 
65  computer  at  the  U.S.  Army  Aviation  Systems  Command,  St.  Louis, 
Missouri.  These  runs  provided  on-the-job  training  to  Government 
analysts  and  verified  the  proper  function  of  the  program  on  that 
computer. 

MAVIS  MODEL  REFINEMENT 


The  basic  goal  of  this  part  of  the  program  was  to  refine  the  data 
input  mechanism  of  the  model  to  allow  its  use  by  maintenance  ana- 
lysts and  programmers  who  are  unfamiliar  with  its  internal  con- 
struction. This  involved  simplification  of  input  data  tables  and 
bypassing  of  simple  data  errors  with  provision  of  error  notifica- 
tion messages. 

The  input  data  tables  were  simplified  by  combining  two  of  them  in- 
to one.  The  Aircraft  Configuration  File  was  combined  with  the 
Component  Mix  input  data  table,  thus  eliminating  the  redundant 
code  information  and  lessening  the  chance  for  input  data  errors. 
This  modification  reduced  the  number  of  input  tables  from  three 
to  two,  the  new  Aircraft  Configuration  - Component  Mix  File  and 
the  Master  Configuration  File.  An  additional  change  was  made  to 
provide  for  automatic  sorting  of  the  Aircraft  Configuration  - 
Component  Mix  File  and  the  Master  Configuration  File  as  they  are 
input  to  the  computer.  This  eliminates  problems  resulting  from 
data  being  input  out  of  sequence,  which  often  occurs  under  the 
old  model  configuration. 

Provisions  to  allow  the  model  to  run  to  completion  with  errors 
present  in  the  input  files  were  added.  Runs  are  now  completed  as 
long  as  the  number  of  input  data  errors  does  not  exceed  a speci- 
fied value  which  is  controlled  by  the  analyst.  In  addition, 
error  messages  are  provided  which  identify  missing  input  data 
cards  and  cases  where  Master  Configuration  File  entries  are  not 
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used.  The  following  headings  with  data,  if  any,  are  now  printed 
each  time  the  model  is  run: 

• A total  of  - errors  were  detected  in  the  ACF  file. 

• Listed  below  are  any  MCF  numbers  not  referenced. 

These  error  message  are  printed  after  the  A Option  is  printed. 

The  refined  model  is  completely  documented  in  the  User's  Manual 
delivered  under  Contract  Data  Item  A009.  (Reference  2.)* 

MAVIS  MODEL  VALIDATION 


For  validation  purposes,  the  MAVIS  Model  was  run  using  data  files 
that  reflected  increasing  dependence  upon  field  data  as  the  data 
sample  size  increased.  Runs  were  made  at  the  conclusion  of  the 
6,  12  and  15  month  points  of  the  field  evaluation. 

At  the  6-month  point,  the  number  of  flying  hours  accumulated  was 
low  (12,035  hours  total  or  33.4  percent  of  the  program  goal). 

There  was  little  confidence  in  the  failure  data  computations  for 
the  field  data  at  that  point.  A Master  Configuration  File  very 
close  to  that  utilized  in  Project  Inspect  Phase  I was  therefore 
used.  The  first  set  of  runs  served  basically  as  verification  of 
the  compatibility  of  the  program  with  the  AVSCOM  computer  and 
proof  of  the  effectiveness  of  the  model  refinements  discussed  in 
the  previous  paragraphs. 

At  the  time  of  the  12  month  validation  runs,  25,225  flying  hours 
or  31.2  percent  of  the  goal  had  been  achieved.  The  Master  Con- 
figuration File  from  Project  Inspect  Phase  I was  therefore  updated 
to  reflect  heavy  dependence  upon  the  field  data.  Significant  re- 
sults were  achieved  which  indicated  substantial  agreement  between 
model  outputs  and  field  results  as  shown  in  Table  11. 


*MAVIS  User's  Manual,  J.M.  Bardis,  T.E.  Kupfrian,  et  al.,  RCA 
technical  report  No.  CR76-588-008,  Burlington,  Massachusetts, 
April  1976. 
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TABLE  11.  MAVIS  MODELING  PREDICTIONS  VERSUS  FIELD  RESULTS 
AFTER  12  MONTHS  OF  TESTING. 


MAVIS 

PREDICTIONS  FIELD  RESULTS 

Gain  in  OR 
Gain  in  Total  MMH/FH 
Gain  in  Major  Insp  MMH/FH 
Flight  Reliability 


2.5% 

0.967 

1.078 

+0.1% 


3.4% 
0.610 
0.992 
-0 . 2% 


Comparison  of  the  numbers  shown  in  Table  11  was  a strong  indica- 
tor that  MAVIS  validation  was  indeed  achieved  or  achievable.  It 
was  then  apparent  that  best  use  of  the  third  (15  months)  valida- 
tion period  could  be  made  if  modifications  or  refinements  to  the 
model  to  improve  its  validity,  accuracy  and  effectiveness  could 
be  made  prior  to  the  third  validation.  These  validation  runs 
would  then  serve  as  a preliminary  test  of  the  modifications  ori- 
ginally scheduled  for  a later  date.  A comprehensive  analysis  of 
the  12-month  validation  results  versus  the  field  results  was  made 
and  it  was  decided  that  adjustments  to  MAVIS  were  required  in  the 
following  areas. 


• Use  of  the  term  "Availability"  rather  than  "Operational 
Readiness"  since  the  model  counts  PMI  time  as  downtime  and 
field  OR  computations  do  not. 

• Inclusion  of  a new  formula  for  availability  which  better 
accounts  for  the  actual  Army  field  application  of  manpower 
during  major  inspections. 

• Addition  of  model  capability  to  account  for  less  intensive 
component  inspections  during  PMI ' s . Originally,  it  was  be- 
lieved that  PMI  inspections  were  the  same  as  PMP  inspec- 
tions on  a per  component  basis. 

• Addition  of  model  capability  to  account  for  the  higher  ef- 
ficiency of  phased  inspection  checklists  when  compared  with 
PMP  lists.  Field  testing  indicated  that  the  average  PMP 
consumes  60  percent  more  look  time  than  the  phased  inspec- 
tion, even  though  the  gross  content  of  the  two  checklists 
as  field  tested  were  very  close  to  each  other  at  the  100- 
hour  points. 

• Modification  of  the  maintenance  man-hour  computations  for 
daily  inspections  to  account  for  the  fact  that  a daily  in- 
spection is  performed  immediately  after  all  major  inspec- 
tion points.  The  original  computation  assumed  that  such 
inspections  were  not  required. 
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Modifications  to  the  model  in  the  above  stated  areas  were  made, 
and  at  the  conclusion  of  15  months  of  testing,  a completely  new 
Master  Configuration  File  was  compiled.  This  file  has  item-by- 
item  correspondence  with  the  present  UH-1H  inspection,  lubrica- 
tion, TBO  and  component  retirements  and  is  completely  drawn  from 
field  data  from  Project  Inspect  Phase  II  with  the  exceptions  of 
individual  component  inspection  times  and  abort  probabilities. 
Inspection  times  for  individual  components  were  not  a part  of  the 
field  data.  Times  utilized  in  the  file  are  touch  times  derived 
from  interviews  of  Fort  Campbell  personnel  and  the  results  of  U.S. 
Navy  Time  and  Motion  Studies  for  UH-1H  Aircraft  Inspections. 
Comparatively  few  aborts  occurred  during  the  Fort  Campbell  test. 
These  aborts  are  attributed  to  individual  components  in  the  field 
data.  Review  of  Abort  probabilities  computed  from  the  field  data 
indicated  that,  in  modes  which  would  cause  mission  or  in-flight 
aborts  computed  out  to  zero  abort  rates.  This  is  an  indication 
that  in  this  one  area  the  test  sample  size  was  too  small  to  pro- 
vide the  desired  granularity  in  data.  For  this  reason  component 
abort  rates  from  the  original  Project  Inspect  Phase  File,  which 
was  drawn  from  a much  larger  sample,  were  used  in  this  final  file 
in  all  cases  except  where  four  or  more  aborts  were  attributed  to 
a component  per  10,000  flight  hours  as  computed  from  the  field 
data . 

The  complete  Master  Configuration  File  as  utilized  in  the  third 
set  of  validation  runs  is  provided  in  Appendix  VII  of  Reference  1. 

VALIDATION  REQUIREMENTS  AND  ACHIEVEMENTS 


The  basic  goals  of  Project  Inspect  Phase  II  are  as  follows: 

• To  validate  the  MAVIS  Model  capability  to  produce  inspec- 
tion schedules  and  checklists  which  provide  increased 
Operational  Readiness  at  reduced  cost  without  jeopardizing 
aircraft  safety. 

• To  refine  the  MAVIS  Model  to  improve  its  accuracy  based 
upon  field  experience. 

Achievement  of  the  first  of  these  goals  was  dependent  upon  three 
areas.  The  first  was  to  successfully  complete  an  effective  field 
test  program  which  indicated  positive  results  for  the  MAVIS  gen- 
erated checklist  from  Project  Inspect  Phase  I.  Second,  it  was 
necessary  to  achieve  a test  sample  size  of  sufficient  magnitude 
to  provide  confidence  in  the  field  evaluation  results.  Third,  it 
was  important  that  approximate  correspondence  exist  between  field 
results  and  MAVIS  predictions  for  the  two  checklists  being  compared. 
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Positive  results  were  achieved  in  all  three  areas  which  contribute 
to  validation.  The  first  requirement,  an  effective  field  test, 
was  completed  with  positive  results.  At  the  end  of  the  15-month 
test,  the  test  companies  achieved  increased  operational  readiness 
at  reduced  cost  (maintenance  man-hours  per  flight  hour)  without 
significant  change  in  flight  reliability.  Review  of  the  field 
test  results  provided  in  the  many  tables  of  the  section  of  this 
report  devoted  to  Data  Reduction  and  Analysis  confirms  this  state- 
ment. In  addition,  the  phased  inspection  system  itself  was  en- 
thusiastically accepted  by  the  Army  personnel  who  participated  in 
the  program.  The  15-month  test  was  completed  smoothly  and  method- 
ically without  any  important  problems  either  with  the  phased 
checklist  or  with  aircraft  safety. 

In  the  second  validation  area,  the  test  sample  size,  statistically 
calculated  during  Phase  I,  indicated  that  a test  sample  resulting 
from  36,000  total  flying  hours  would  provide  sufficient  confidence 
in  the  comparative  results.  A total  of  38,342  flying  hours  was 
achieved  during  the  test,  a figure  well  in  excess  of  the  goal. 
Further  confidence  calculations  performed  at  the  end  of  the  test 
confirmed  the  adequacy  of  the  test  sample  size. 

In  the  third  area,  the  correspondence  between  test  results  and 
MAVIS  predictions,  Table  11,  and  the  related  discussion  presented 
in  the  previous  paragraphs  shows  this  requirement  to  have  been 
sufficiently  achieved  at  the  end  of  12  months  of  testing. 

In  summary,  it  can  be  stated  that  the  requirements  for  MAVIS  vali- 
dation were  successfully  achieved  during  the  test  program.  The 
MAVIS  Model  then,  with  some  refinement  to  improve  its  ability  to 
predict  the  relative  merit  of  competing  inspection  schemes,  can 
effectively  be  used  in  the  development  of  checklists  for  other 
aircraft  and  material. 

RESULTS  OF  FINAL  VALIDATION  RUNS 


As  noted  in  the  discussion  following  Table  11,  the  final  valida- 
tion runs  were  made  with  the  MAVIS  modified  in  several  areas  to 
improve  its  validity  and  accuracy.  Furthermore,  component  data 
files  were  compiled  with  maximum  dependence  upon  the  Project  In- 
spect Phase  II  field  data.  Validation  runs  were  made  for  the  25/ 
100  intermediate/periodic  and  100/800  phased  inspection  schemes. 
The  average  monthly  utilization  and  average  flight  duration  input 
to  MAVIS  were  equal  to  the  actual  averages  over  the  15-month  test 
period  at  Fort  Campbell  (i.e.,  21.3  flight  hours  per  month  and 
1.3  hours  per  flight). 


Basic  field  data  results  to  be  compared  with  MAVIS  predictions 
drawn  from  15  months  of  field  data  are  shown  in  Table  12. 


TAB’ E 12.  EVALUATION  CRITERIA  FIELD  RESULTS. 


Parameter 

Test 

Group 

Results 

Control 

Group 

Results 

Delta 

Availability 

76.9% 

74 . 8*7. 

2.17. 

Major  Inspection  MMH/FH 

1.025 

1.937 

0.912 

Daily  Inspection  MMH/FH 

1.048 

0.840 

0.208 

Total  MMH/FH 

4.32 

4.97 

0.65 

Mission  Reliability 

98.47. 

98 . 67. 

0 . 27. 

*The  availability  value  for 

the  control 

group  is 

the  field  col- 

lected  OR  value  modified  to  consider  all  PMI  times  charged  as 
downtime.  (Reference  should  be  made  to  the  "May  1975"  explana- 
tion on  page  94.)  The  availability  calculation  used  is:  total 

group  hours  in  OR  Status  minus  the  total  group  hours  expended 
for  PMI ' s , divided  by  the  total  group  calendar  hours,  all  multi- 
plied by  100  percent. 

The  summary  results  from  the  two  final  validation  runs  are  pre- 
sented in  Table  13.  Complete  copies  of  the  printouts  from  these 
runs  including  all  option  outputs  are  presented  in  Appendices 
VIII  and  IX  of  Reference  1. 


TABLE  13.  MAVIS  MODEL  PREDICTIONS  FOR  VALIDATION. 


Parameter 

100/800 

Phased 

25/100 

Intermedia  te/ 
Periodic 

Delta 

Availabil ity 

96.07.** 

93 . 27. 

2.87. 

Major  Inspection  MMH/FH 

0.349 

0.680 

0.331 

Daily  Inspection  MMH/FH 

0.886 

0.886 

0 

Total  MMH/FH 

1.942 

2.276 

0.334 

Mission  Reliability 

98.17. 

98 . 17. 

0 

**MAVIS  availability  projections  are  greater  than  typical  field 
values  because  accounting  of  NORS  times,  administrative  times, 
and  personnel  inefficiency  times  is  not  performed.  Additionally, 
the  model  does  not  count  repair  work  of  one  hour  or  less  as 
operationally  ready  time  as  AR95-33  does. 
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In  comparing  field  results  with  MAVIS  predictions,  the  differ- 
ences between  model  considerations  and  content  of  field  data  in 
the  area  of  maintenance  times  must  be  considered.  Field  data 
maintenance  man-hour  figures  contained  all  time  charged  by  main- 
tenance personnel,  including  NORS  time,  administrative  time  and 
time  required  due  to  personnel  inefficiencies.  MAVIS  operates  on 
the  best  data  available  from  field  collection.  Field  data  in- 
cludes recorded  actuals  for  repair  times  by  component  but  pro- 
vides no  breakdown  of  inspection  times  by  component.  Field  data 
(as  recorded  on  the  2407  forms)  also  does  not  reconcile  directly 
to  OR,  NORS  or  NORM  (as  recorded  on  the  1352  forms).  MAVIS 
therefore  operates  on  estimates  of  per  component  inspection  touch 
times  derived  from  field  interviews  and  time  studies.  MAVIS  does 
not  consider  NORS  times,  administration  time  or  personnel  inef- 
ficiency time  except  where  they  may  be  contained  within  recorded 
repair  times  which  are  used.  Consistent  one-for-one  comparisons 
can  be  made  between  field  results  for  different  inspection  sys- 
tems or  between  MAVIS  predictions  for  these  systems.  When  com- 
paring field  results  with  MAVIS  predictions,  consideration  must 
be  given  to  these  differences  in  data  factors . This  is  a draw- 
back only  in  this  validation  process.  When  MAVIS  is  used  in  the 
normal  evaluation  of  inspection  schemes,  it  is  a direct  process 
since  the  same  Master  Configuration  File  is  utilized  for  all 
schemes  investigated  for  an  aircraft  and  comparative  results  are 
required  in  selecting  the  best  scheme. 

The  following  are  discussions  of  comparative  field  results  and 
MAVIS  predictions  for  each  of  the  parameters  from  Tables  12  and 
13. 


Availability 

The  MAVIS  Model  computations,  as  noted  above,  do  not  consider 
NORS  and  do  not  estimate  administrative  time  or  personnel  in- 
efficiency. They  are  therefore  higher  absolute  values  than  the 
field  results.  The  predicted  and  measured  Deltas  between  the 
inspection  schemes  are  significant.  The  adjusted  MAVIS  pre- 
dicts a 2.8-percent  increase  in  availability,  which  is  close  to 
the  2.1-percent  field  measured  quantity. 

Major  Inspection  MMH/FH 

Field  results  show  a saving  of  0.912  MMH/FH  or  47  percent  in 
major  inspection  time.  MAVIS,  utilizing  only  touch  time,  pre- 
dicts a saving  of  0.331  MMH/FH  or  48.6  percent.  MAVIS  computa- 
tions (see  Appendices  VIII  and  IX  of  Reference  1)  show  total 
time  per  100  flight  hours  for  major  inspections  to  be  69  hours 
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for  the  25/100  scheme  and  35  hours  for  the  100/800  scheme. 

Table  5 on  page  84  of  this  report  shows  total  field  time  per 
100  flight  hours  for  major  inspections  to  be  193.3  hours  for 
the  25/100  scheme  versus  102  hours  for  the  100/800  scheme.  A 
consistent  savings  approximating  47  percent  exists  in  all  these 
comparative  figures. 

Daily  Inspection  MMH/FH 

MAVIS  predicts  identical  times  for  the  two  schemes.  This 
should  be  the  case  since  PMD  inspection  requirements  are  the 
same  regardless  of  inspection  scheme  and  because  Army  policy 
dictates  the  same  number  of  inspections  be  made  over  the  100- 
hour  period  regardless  of  inspection  scheme.  Field  data  indi- 
cates test  company  PMD's  to  require  0.208  MMH/FH  more  than  con- 
trol company  PMD's  (15  months  of  cumulative  data).  It  must  be 
noted  that  in  the  beginning  of  the  test  program  PMu  recording 
was  highly  inconsistent  and  after  three  months,  test  companies 
PMD  times  were  about  0.790  MMH/FH  higher  than  control  company 
times.  After  that  time,  more  consistent  recording  was  achieved 
and  the  difference  converged  to  the  0.208  value.  The  data  bank 
is  cumulative  and  therefore  contains  a permanent  skew  due  to 
these  early  recording  problems.  In  this  case,  it  is  believed 
that  MAVIS  provides  the  superior  comparative  result. 

Total  MMH/FH 

Field  results  show  a saving  of  0.65  MMH/FH  or  13.1  percent  in 
total  maintenance  man-hours.  MAVIS,  utilizing  touch-time  for 
inspection  time  and  ignoring  administrative  time  and  personnel 
inefficiency  predicts  a saving  of  0.334  MMH/FH  or  14.7  percent. 
The  percentage  differences  are  sufficiently  close  to  assure 
that  MAVIS  closely  tracks  actual  field  manpower  expenditures. 

Mission  Reliability 

Field  results  for  mission  reliability  track  closely  with  MAVIS 
predictions  in  absolute  value  and  in  the  comparative  difference 
between  the  inspection  schemes.  MAVIS  shows  no  differences  to 
exist  between  the  schemes  while  field  data  indicate  a loss  of 
0.2  percent.  These  figures  are  so  close  that  they  are  recon- 
cilable within  the  errors  that  can  exist  within  the  round-offs 
and  truncations  which  are  a part  of  both  computer  computations. 

MAVIS  IMPROVEMENTS 

During  the  late  stages  of  Project  Inspect  Phase  II,  a number  of 
model  improvements  and  updates  were  made  to  the  MAVIS  Model 
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calculation  program.  Most  of  these  improvements  were  made  in 
preparation  for  the  turnover  of  the  program  to  the  Army,  but  some 
were  added  because  they  were  found  to  be  extremely  useful  during 
the  validation  and  checklist  update  tasks.  These  improvements 
are  explained  as  part  of  the  MAVIS  User's  Manual  (Reference  2) 
but  can  be  enumerated  as  follows: 

• Reorganization  of  the  three  MAVIS  Programs 

• Simplification  of  the  specification  of  scheme  data 

• New  use  of  some  MCF  data  fields 

• Multiple  run  and  multiple  ACF  and  MCF  capability 

• 'A'  Option  Sensitivity  Capability 

Reorganization  of  MAVIS  Programs 

The  MAVIS  Programs  and  their  subroutines  have  been  organized  so 
their  statements  are  in  logical  order  and  they  have  been  liberally 
supplemented  with  "comment"  statements.  This  has  made  the  compi- 
lation listings  far  easier  to  read  and  obviated  the  need  for  de- 
tailed flow  charts. 

A MAVIS  run  actually  consists  of  three  separate  programs: 

1.  Card-to-Disk  Program 

2.  Analysis  Program 

3.  Checklist  Program 

Figure  29  shows  the  flow  of  data  and  control  during  a MAVIS  run. 
The  Card-to-Disk  Program  is  used  to  preprocess  the  Aircraft  Con- 
figuration File  (ACF)  and  Master  Configuration  File  (MCF)  cards 
for  use  by  the  second  program.  The  Card-to-Disk  Program  also 
prints  the  ACF  and  the  MCF  disk  files.  The  Analysis  Program  pro- 
cesses the  ACF  and  MCF  disk  files  created  by  the  first  program 
and  generates  most  of  the  MAVIS  outputs  including  "Option  A", 
"Option  B",  and  "Option  C"  outputs  as  specified  by  the  data  cards 
for  each  scheme.  The  third  program  is  used  to  post-process 
"Check  List"  inspection  points  and  intervals  generated  by  the 
Analysis  Program.  It  prints  all  components  to  be  checked  at  each 
inspection  interval  by  area. 
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• DATA  FLOW 
►CONTROL  FLOW 


Figure  29.  MAVIS  Model  Programs. 

Scheme  Data  Specification 

The  inputting  of  scheme  data  is  now  handled  by  two  data  cards. 

The  programmer/analyst  can  now  independently  specify  inspection 
crew  size  and  repair  crew  size.  Scheme  parameters  for  the  Analysis 
Program  include  the  following: 

1.  Length  of  inspection  interval  I . , 

2.  Length  of  Inspection  cycle  I ln  fUght  hours  or  da),s 

3.  Average  inspection  crew  size 

4.  Average  repair  crew  size 

5.  Whether  preflight,  postflight  and/or  daily  (flight 
readiness)  inspections  will  be  allowed 
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6.  Flight  hours/month 

7.  Average  flight  duration 

8.  MIN  LIM  - used  to  flag  flight  cri  :cal  items. 

MCF  Data  Field  Usage 

During  Project  Inspect  Phase  II,  attempts  were  made  to  make  the 
Master  Configuration  File  as  self-explanatory  as  possible.  The 
final  refined  MCF  is  provided  as  Appendix  VII  of  the  Interim 
Technical  Report  (Reference  1)  or  Appendix  J of  the  MAVIS  User's 
Manual  (Reference  2).  Two  data  fields  were  used  to  provide  a 
direct  reference  to  the  checklist,  NOMENCLATURE  and  INSPECTN 
AREAS.  The  last  part  of  the  nomenclature  field  was  used  to  in- 
dicate definition,  and  the  kind  of  check  or  inspection  method 
used  for  that  component.  Among  the  definitions,  checks,  and 
functions  listed  are  system,  subsystem,  visual  check,  visual 
function,  mechanical  function  check,  measurement,  friction  check, 
lube  gun,  retirement,  overhaul,  lube-handpack , tension  check, 
remove  check,  wipe  clean,  flush  clean,  timing  check,  balance 
track,  clean,  replace,  remove-check  and  clean,  drain  and  refill, 
test  switch,  sample  jar,  weight  check,  etc.  As  you  can  see,  in- 
formation placed  in  this  field  is  only  limited  by  the  number  of 
character  places  available.  The  use  of  the  nomenclature  field  in 
this  manner  obviated  the  need  for  the  specification  of  inspection 
method  by  identity  number;  that  is  the  reason  the  flight  readi- 
ness (FR)  and  SCH  METH  fields  are  left  blank. 

The  inspection  area  field  was  also  used  slightly  differently. 

The  number  of  inspection  areas  which  can  be  specified  was  limited 
to  four  to  allow  listing  of  both  inspection  area  and  checklist 
step  number.  Now  there  is  a direct  link  to  the  actual  written 
inspection  instruction  in  the  checklist. 

Multiple  Run  Capability 

As  shown  on  Figure  29,  a maximum  of  six  Aircraft  Configuration 
Files  and  four  Master  Configuration  Files  can  now  be  handled  by 
MAVIS.  This  opens  up  a number  of  multiple  run  possibilities, 
some  of  which  may  be  practical.  For  example,  six  models  of  the 
same  aircraft  could  be  run  at  the  same  time,  four  different  air- 
craft can  be  run  at  once  (all  independently  analyzed),  or  six 
inspection  schemes  for  a given  aircraft  can  be  run  at  the  same 
time . 
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Sensitivity  Analysis  Capability 


Option  'A'  of  the  MAVIS  Model  prints  out  the  calculated  component 
data  derived  from  one  ACF  and  one  MCF  file.  Option  A basically 
furnishes  data  on  scheduled  and  unscheduled  inspection  and  repair 
maintenance  man-hours,  abort  occurrences,  and  repair  quantities 
all  based  on  a 10,000  flying-hour  simulation  for  a specified  in- 
spection interval.  Sensitivity  has  been  added  to  this  option  to 
allow  a series  of  simulations  based  on  the  100-hour,  800-hour 
cycle  inspection  scheme.  When  the  sensitivity  option  is  selected, 
calculations  and  printouts  will  be  made  which  provide  what  hap- 
pens not  only  at  the  specified  interval  but  at  100-,  200-,  400- 
and  800-hour  inspection  intervals.  Figure  30  illustrates  the  re- 
sulting printout  format.  Note  the  first  component  printed,  "Nose 
Skin/Structure",  had  100  hours  as  the  input  specified  interval 
while  the  second  component,  "Roof  Windows",  had  400  hours 
specified . 

CHECKLIST  UPDATE 


One  of  the  last  major  tasks  of  Project  Inspect  Phase  II  was  to  up- 
date and  in  some  areas  rewrite  the  phased  inspection  checklist 
tested  at  Fort  Campbell.  This  effort  could  not  be  started  until 
the  data  bank  was  complete,  and  the  MAVIS  Model  refined  and  vali- 
dated. Data  gathered  from  the  test  was  sufficiently  accurate  and 
far  superior  to  the  original  design  data  used  in  Phase  I.  There- 
fore, an  almost  complete  redesign  of  the  schedule  and  checklist 
was  performed.  Component  intervals  and  the  inspection  mix  were 
adjusted  in  accordance  with  the  final  refined  MAVIS  run  results 
(refer  to  Appendix  K of  Reference  2).  Checklist  statements  were 
rewritten  to  incorporate  inspection  techniques  used  and  to  ensure 
inspection  for  the  high  failure  causes  of  all  components  as  de- 
noted by  the  Fort  Campbell  data  bank.  Finally,  the  checklist 
steps  were  typed  on  a new  format  derived  from  RCA-AVSCOM  dis- 
cussions . 

MAVIS  Modeling  Influence  On  Checklist 

The  MAVIS  Modeling  work  heavily  influenced  three  changes  to  the 
checklist : 

• Inspection  Step  Technique  Additions 

• Inspection  Area  Adjustment 

• Inspection  Interval  Adjustment 

The  MAVIS  User's  Manual  (Reference  2)  explains  in  detail  the  work 

involved  in  making  these  adjustments  and  additions.  The 
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Figure  30.  Inspection  Scheme  Component  Summary  Sensitivity  Printout. 


inspection  interval  adjustments  were  made  using  the  MAVIS  Option 
'A'  output.  Option  'A'  provides  component  data  rates  per  10,000 
flight  hours  and  is  a close  link  to  the  inspection  steps  them- 
selves. The  sensitivity  feature  illustrated  in  Figure  30  was 
used  to  simplify  this  selection  process.  Three  component  rates 
were  used  to  select  the  optimum  interval:  total  MMH,  mission  a- 
borts,  and  the  component  contribution  to  downtime.  The  first  two 
items  are  a part  of  the  normal  'A'  Option  printout,  but  the  last 
item  was  specially  programmed  for  the  UH-1H  checklist  update. 

Space  on  the  'A'  Option  printout  has  been  fully  assigned;  this 
precluded  the  latter  items  addition  to  the  delivered  MAVIS  Model. 
The  sensitivity  feature  was  very  helpful  in  shortening  a normally 
iterative  computer  run  process.  This  allowed  the  analyst  to 
select  the  optimum  interval  with  a minimum  of  study. 

Checklist  Format 

The  checklist  format  used  for  the  field  test  (Figure  31)  was  se- 
lected for  its  compatibility  with  the  current  intermediate- 
periodic  checklists  to  assure  a fair  comparative  field  test.  As 
such,  it  had  a number  of  weaknesses  which  were  known  before  the 
test  and  emphasized  by  the  test.  Foremost  among  the  current 
checklist  documentation  inefficiencies  is  the  fact  that  they  are 
not  working  documents.  Users  in  the  field  must  copy  portions  of 
the  checklists  from  plastic  cards  onto  the  DA  Form  2404  in  order 
to  record  status,  deficiences  and  corrections.  This  is  a step 
that  can  be  eliminated  by  providing  a "work  oriented"  checklist. 

Such  a checklist  has  been  designed  by  RCA/AVSCOM  personnel  and  is 
illustrated  in  Figure  32.  Study  of  the  format  also  resulted  in  a 
number  of  content-related  recommendations.  These  stated  that  the 
checklist  should  include: 

• Single-side  printing  at  appropriate  inspection  package  and 

system  break  points 

• Contents 

- Area  and  access  cover  lists  with  drawings 
Preparatory  instructions  for  inspection 
Area  organized  inspection  steps 

- Power-on  checks 

- Reference  to  Avionics  and  Armament  inspections. 

Final  UH-1H  Checklist 

The  final  UH-1H  Phased  Inspection  Checklist  is  presented  in  Appen- 
dix A.  The  magnitude  of  work  involved  in  refining  it  can  be 
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PUBLICATION  NO.  Unassigned 

— 

AREA  NO.  12 

Main  Rotor  and  Mast  Area 

PUBLICATION  DATE:  i june  73 

CHANGE  NO.  None 

ELECTRIC  POWER  Q ON  [x]  OFF 

PHASE  NO. 


6 7 


I 2 . 1 Main  rotor  hub,  blade  grips,  pitch  horns, 
and  drag  braces  for  visible  damage  and 
security.  Para.  8-5. 


INSPECTION  REQUIREMENT 


I 1.  I Main  rotor  blades  for  scratches,  nicks, 

dents,  erosion  of  leading  edge,  and  evidence 
of  bond  failures.  Para.  8-4. 


, 3.  [Main  rotor  pillow  block  and  grip  reservoirs 
for  oil  level,  leakage,  and  contamination. 

Para.  8-5. 

Main  rotor  pillow  block  reservoir  sight 
glasses  cleaned  (interior  surface)  and 
reservoir  flushed. 


4. 


5.  Main  rotor  grip  reservoir  sight  glasses 
cleaned  (interior  surface)  and  reservoir 
flushed. 


| 6.  | Main  rotor  pitch  links  for  excessive  radial 
or  axial  play  in  bearings.  Para.  8-3. 


1 7.  jstabilizer  bar  and  connecting  linkage  for 
nicks,  scratches,  dents,  and  worn  bearings 

Para.  8-6. 


| 8.  |stabilizer  bar  tube  assembly  for  cracks. 

Pay  particular  attention  to  inboard  5 inches 
where  tube  assembly  attaches  to  stabilizer 
bar  centerframe.  Para.  8-6. 

9.  Stabilizer  dampers  for  full  fluid  level  and 
proper  timing. 


|l0.  |Main  rotor  mast  for  distortion,  cracxs  and 
dents.  Para.  8-2. 

11.  Main  rotor  mast  dust  boot  for  deterioration 
and  security. 

12.  Collective  sleeve  drive  plate  for  excessive 
play  where  engaged  with  mafn  rotor  mast 
splines. 


MECH. 


Figure  31.  Checklist  Format  Used  During  Field  Evaluation. 
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Figure  32.  Project  Inspect  Phase  II  Developed  Checklist  Format 


} 


simply  stated  by  comparing  the  number  of  inspection  steps  and  in- 
spection intervals  with  the  checklist  tested  at  Fort  Campbell. 
Excluding  Power  On  checks,  the  new  checklist  contains  293  steps, 
while  the  old  one  contained  239  steps.  Table  14  lists  the  inter- 
val percentages  for  each  checklist.  Those  components  affected  by 
the  100-hour  interval  have  been  drastically  reduced,  while  a cor- 
responding increase  in  200,  400,  and  800  hour  intervals  has  oc- 
curred. The  new  inspection  steps  have  also  been  made  more  speci- 
fic as  to  the  inspection  method  and  the  component  involved. 


TABLE  14. 

INTERVAL  CHANGES 

- UH-lH  PHASED 

CHECKLIST. 

INTERVAL 

OLD  CHECK- 

NEW CHECK- 

INCREASE 

(HRS) 

LIST  (°/„) 

LIST  (%) 

m 

100 

71.3 

38.1 

(33.2) 

200 

19.8 

20.4 

0.6 

400 

5.9 

31.6 

25.7 

800 

3.0 

9.9 

6.9 

In  addition,  a human  factors  approach  was  used  that  reduced  "up- 
down"  motion  and  promoted  a "wa lk-around"  philosophy  where  appli- 
cable. The  inspection  areas  and  inspection  steps  within  an  area 
have  also  been  ordered  using  human  factors  considerations.  The 
magnitude  of  the  changes  are  sufficient  to  warrant  a new  valida- 
tion effort  by  experienced  technical  inspectors.  The  validation 
process  should  determine  the  minimum  list  of  access  panels  by 
phase  and  add  this  list  to  the  checklist.  This  will  reduce  in- 
spection time  by  eliminating  unnecessary  inspections  (mechanics 
and  TI ' s have  a tendency  to  inspect  an  area  if  it  is  exposed). 

It  is  also  recommended  that  the  validation  team  determine  optimum 
"split"  points  so  a three-man  inspection  team  can  be  utilized  ef- 
fectively. The  checklist  is  currently  ordered  optimumly  for  one 
man  to  carry  out  the  complete  inspection.  The  determination  of 
"split"  points  will  allow  a team  to  remove  a part  of  the  check- 
list and  to  parcel  out  the  inspection  responsibilities. 
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PHASED  INSPECTION  SYSTEM  TEST  RESULTS 


Many  of  the  test  results  have  been  presented  in  the  sections  en- 
titled Data  Reduction  and  Analysis  and  MAVIS  Model  Refinement  and 
Validation.  Disregarding  possible  data  biases  previously  discus- 
sed, cumulative  data  produced  by  the  DMS  system  indicates  the  fol- 
lowing test  group  advantages  that  occurred  under  Fort  Campbell 
operational  conditions: 

• 1.1  Percent  Increased  OR  (1352  Data) 

• 0.70  MMH/FH  Savings  in  Inspection  Labor 

• 0.65  MMH/FH  Total  Labor  Savings 

• Lower  Spares  Usage  and  Costs  ($942,898) 

This  section  presents  refined  MAVIS  results  and  confidence  calcu- 
lation results,  and  discusses  the  phased  systems  apparent  effect 
on  support  costs  and  labor  distribution. 

MAVIS  SUMMARY  RESULTS 


MAVIS  results  have  been  given  and  discussed  previously  in  relation 
to  the  validation  and  model  refining  work.  However,  after  the 
validation  was  accomplished  and  the  model  completely  refined  and 
updated,  a final  MAVIS  run  was  made  to  indicate  the  improvement 
offered  by  the  new  checklist  over  the  old  checklist.  Figure  33 
presents  those  results  in  inspection  scheme  summary  matrix  form. 


25/100 

VALIDATED 

REFINED  (NEW 

UH-lH 

UH-lH 

CHECKLIST) 

FLIGHT  RELIABILITY 

0.992 

0.992 

0.993 

MISSION  RELIABILITY 

0.981 

0.981 

0.981 

AVAILABILITY 

0.932 

0.960 

0.964 

NORM  - SCHEDULED 

0.060 

0.031 

0.027 

NORM  - UNSCHEDULED 

0.008 

0.009 

0.009 

MH/FH  - FLT-READINESS  INSP 

0.886 

0.886 

0.886 

MH/FH  - SCHEDULED  - 

LOOK 

0.680 

0.349 

0.291 

MH/FH  - SCHEDULED  - 

FIX 

0.355 

0.299 

0.287 

MH/FH  - UNSCHEDULED 
MAINTENANCE 

0.355 

0.408 

0.420 

MH/FH  - TOTAL 

2.276 

1.942 

1.883 

UNSCHEDULED  MTBM 

8.3 

7.3 

7.1 

Figure  33.  Combined  Final  MAVIS  Results. 
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Listed  are  the  summary  results  for  the  intermediate/periodic  in- 
spection scheme  (25/100),  the  phased  inspection  system  tested  at 
Fort  Campbell  (Validated),  and  the  new  inspection  schedule  pro- 
vided in  Appendix  A of  this  report  (Refined).  The  latter  inspec- 
tion scheme  results  show  the  improvements  predicted  by  the  model 
for  the  final  checklist  update  effort.  This  includes  both  inspec- 
tion interval  and  inspection  mix  changes.  Note  that  mission  re- 
liability, NORM  and  flight  reliability  stay  about  the  same  but 
that  availability  increases  slightly.  In  turn,  the  unscheduled 
mean-time-between-maintenance  actions  (MTBM)  improves  by  0.2  of 
an  hour.  By  far  the  greatest  effect  is  in  the  labor  area.  Both 
scheduled  inspect  and  repair  time  have  improved,  resulting  in  a 
saving  of  3 percent.  This  saving  is  on  top  of  the  14.7  percent 
saving  achieved  by  the  validated  checklist  over  the  25/100  check- 
list. The  25/ 10^  column  is  provided  to  furnish  MAVIS  comparison 
data  for  the  int jrmediate/periodic  inspection  system. 

Comparison  With  Early  MAVIS  Work 

Phase  I of  Project  Inspect  developed  the  first  version  of  the 
100/800  phased  inspection  system  for  the  UH-1H  aircraft.  That 
development  effort  was  based  on  a UH-1  MAVIS  data  bank  drawn  from 
combined  3-M  (Navy,  Marines)  and  Army  sources.  Phase  I developed 
the  checklist  tested  by  Phase  II.  The  inspection  intervals  in 
that  checklist  were  conservatively  selected  via  liberal  use  of 
engineering  judgement  because  of  a "lack  of  faith"  in  the  combined 
data  bank.  It  is  of  note  that  many  of  the  conservative  judgements 
made  during  Phase  I did  not  need  to  be  made  during  Phase  II.  The 
Phase  II  sample  data  collection  produced  data  of  high  accuracy, 
enabling  removal  of  overly  conservative  influences  on  the  new 
checklist . 

Figure  34  illustrates  the  high  improvement  Phase  II  achieved  over 
Phase  I in  terms  of  the  MAVIS  modeling  projections.  The  Phase  I 
modeling  work  was  performed  and  presented  in  April  1973  and  does 
not  include  the  validation  model  improvements  noted  in  the  pre- 
vious section.  However,  the  improvement  is  of  a magnitude  (with 
the  exception  of  availability)  to  prove  the  importance  of  sample 
data  collection  and  the  importance  of  refining  a checklist  after 
it  has  been  used  for  a period  of  time. 


136 


FLIGHT  RELIABILITY 
MISSION  RELIABILITY 
AVAILABILITY 
NORM  - SCHEDULED 
NORM  - UNSCHEDULED 

PHASE  I 
MODELING 

0.979 

0.927 

0.967 

0.018 

0.015 

PHASE  II 
MODELING  (NEW 
CHECKLIST) 

0.993 

0.981 

0.964 

0.027 

0.009 

MH/FH  - FLT-READINESS  INSP 

1.653 

0.886 

MH/FH  - SCHEDULED  - 

LOOK 

0.589 

0.291 

MH/FH  - SCHEDULED  - 

FIX 

0.427 

0.287 

MH/FH  - UNSCHEDULED 

MAINTENANCE 

0.776 

0.420 

MH/FH  - TOTAL 

3.446 

1.883 

UNSCHEDULED  MTBM 

3.5 

7.1 

AVERAGE  UTILIZATION  (FH/MO.)  25  21.3 

AVERAGE  FLIGHT  DURATION  (HRS.)  2.9  1.3 


Figure  34.  MAVIS  Summary  Results,  Project  Inspect,  Phase 
I and  II. 


CONFIDENCE  RESULTS 


In  the  Project  Inspect  Phase  II  proposal,  a field  test  consisting 
of  sample  data  gathering  for  a period  of  12  months  (36,000  flying- 
hours)  was  recommended.  A statistical  analysis  was  performed  at 
that  time  to  estimate  the  length  of  time  required  and  to  project 
the  confidence  in  evaluation  results  obtainable  (to  provide  a de- 
terminant comparison  between  the  two  inspection  systems).  A con- 
fidence level  of  80  percent  was  projected  for  36,000  flying  hours. 

At  the  end  of  the  formal  field  evaluation,  confidence  calculations 
were  performed  to  determine  the  statistical  confidence  in  the  DMS 
results,  indicating  that  the  phased  inspection  schedule  was  indeed 
superior  to  the  intermediate/periodic  schedule.  Confidence  calcu- 
lations were  performed  while  testing  the  variables  OR  and  MMH/FH 
to  determine  if  the  field  test  was  statistically  successful.  The 
statistical  method  used  (refer  to  Appendix  B)  has  the  following 
statement  (Case  2,  Paragraph  3-3,  AMCP  706-110):  The  variability 

in  performance  of  each  A (Test  Group)  and  B (Control  Group)  is  un- 
known, and  it  is  not  reasonable  to  assume  that  they  both  have  the 
same  variability.  The  result  of  the  Test  versus  Control  compari- 
son for  MMH/FH  showed  an  overwhelming  confidence  in  the  improved 
result  achieved  by  the  Test  Group.  However,  it  was  noted  that 
company  selection  to  each  group  was  extremely  important  to  the 
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outcome.  This  triggered  further  calculations  comparing  the  test 
companies  of  one  BN  with  the  test  companies  of  the  other  BN. 
Similarly,  the  control  companies  of  one  BN  were  compared  with  the 
control  company  of  the  other  BN.  An  interesting  and  perhaps  un- 
expected result  occurred.  These  comparisons  indicated  a very 
high  confidence  that  the  two  Battalions  were  from  completely  dif- 
ferent populations.  (Refer  to  Appendix  B.)  In  other  words,  for 
statistical  evaluation  purposes,  the  two  battalions  were  found  to 
perform  and  report  so  differently  that  they  should  not  be  lumped 
together  in  terms  of  Project  Inspect' s Test  and  Control  Groups. 
Therefore,  to  compare  test  versus  control  results,  calculations 
had  to  be  performed  within  the  same  battalion.  This  had  the  ef- 
fect of  cutting  the  sample  size  drastically  but  it  produced  two 
test  versus  control  sample  comparisons,  one  for  each  battalion. 
(Refer  to  Appendix  C for  OR  and  MMH/FH  data  on  these  two  samples.) 
The  results  of  the  calculations  are  provided  in  Table  15. 


TABLE  15.  CONFIDENCE  ESTIMATE  FOR  FIELD  RESULTS. 


Test  Control 

Companies  Companies 


Tested  Confidence 

Variable  Level 


B,  D-lOlst  BN  C-lOlst  BN  OR  94.2% 
B,  D-lOlst  BN  C-lOlst  BN  MMH/FH  98.1% 
D-158th  BN  B,  C-158th  BN  OR  83.4% 
D-158th  BN  B,  C-158th  BN  MMH/FH  88.4% 


Note  that  in  both  battalions,  a higher  confidence  level  was 
achieved  for  the  variable  MMH/FH.  This  indicates  that  there  is 
higher  confidence  in  the  interval  estimate  of  the  true  difference 
of  MMH/FH  between  the  test  and  control  companies.  In  all  calcula- 
tions, the  confidence  level  exceeded  the  original  projection. 

These  results  clearly  indicate  that  a determinant  comparison  be- 
tween the  two  inspection  systems  has  been  achieved.  Furthermore, 
the  superior  results  accomplished  by  the  test  companies  should  be 
looked  at  with  high  confidence. 


SUPPORT  COST  EFFECT 


The  test  implementation  of  the  phased  inspection  schedule  resulted 
in  a savings  due  primarily  to  a reduction  in  inspection  workload. 
This  reduced  labor  costs  (MMH/FH)  from  4.974  for  the  control  group 
to  4.322  for  the  test  group.  The  inspection  portion  of  the  work- 
load can  be  considered  to  consist  of  the  following  inspection 
types:  PMD,  PMI , Special,  Phased  and  PMP.  In  the  case  of  the 

test  group,  the  inspection  portion  of  the  total  workload  was  58.8 
percent  while  in  the  control  group  it  was  62.9  percent.  Figure  35 
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illustrates  the  overall  maintenance  man-hour  distribution  in  pie 
chart  form. 


MAINTENANCE  MAN-HOURS  PER  FLYING  HOUR 


(INTERMEDIATE/PERIODIC) 


Figure  35.  Project  Inspect  UH-1H  Support  Cost  Changes. 

The  test  group  breakdown  has  been  computed  from  the  same  base  as 
the  control  group  (4.974  MMH/FH).  The  change  shown  indicates  a 
small  increase  in  unscheduled  maintenance  actions,  a large  de- 
crease in  scheduled  maintenance  actions  and  savings  of  13.1  per- 
cent . 

LABOR  REDISTRIBUTION 

From  early  MAVIS  Modeling  work  it  was  evident  that  labor  (MMH/FH) 
spent  for  the  different  inspection  types  would  change  or  be  re- 
distributed with  the  implementation  of  the  phased  inspection 
schedule.  This  can  be  shown  by  looking  at  the  modeling  results 
provided  in  Figure  33.  The  "Refined"  and  "25/100"  data  columns 
of  Figure  33  have  been  drawn  in  pie  chart  form  to  illustrate  this 
point.  Figure  36  shows  the  results. 
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MAVIS  INSPECTION  MODELING  LABOR 


0 


INTERMEDIATE/PERIODIC  PHASED 


Figure  36.  MAVIS  Labor  (MMH/FH)  Pie  Redistribution. 

It  is  shown  that  daily  inspections  now  consume  a greater  portion 
of  the  total  inspection  labor  involved.  In  addition,  the  major 
inspection  portion  has  decreased  and  the  unscheduled  maintenance 
portion  has  increased.  A similar  redistribution  in  inspection 
labor  occurred  in  the  field.  Test  results  at  Fort  Campbell  are 
shown  in  Figure  37. 

EORT  CAMPBELL  UH-IH  OPERATIONAL  RESULTS 
(15  MONTHS) 


c> 


CONTROL  GROUP  TEST  GROUP 

(INTERMEDIATE/PERIODIC)  (PHASED) 


Figure  37.  Inspection  Labor  (MMH/FH)  Pie  Redistribution. 
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The  redistribution  of  daily  inspection  (PMD)  labor  is  clearly 
shown  as  an  increase.  The  major  inspections  of  the  control  group 
(PMP  and  PMI)  decrease  to  form  the  "Phased"  portion  of  the  pie  in 
the  test  group.  Also  resulting,  is  a small  increase  in  the 
special  inspection  category.  This  is  caused  primarily  by  the  fact 
that  a smaller  total  labor  base  was  used  to  compute  the  test  group 
percentage  figures.  (The  test  group's  total  for  inspection  labor 
is  lower  than  the  control  group's.)  It  can  be  concluded  that 
phased  inspection  system  implementation  has  provided  an  overall 
labor  saving  (Figure  35),  a reduction  in  inspection  related  labor, 
and  a redistribution  of  effort  spent  performing  the  various  in- 
spections. Further  efficiency  improvements  are  possible,  and  it 
would  be  logical  to  reduce  the  greatest  consumer  of  inspection 
labor,  the  daily  inspection. 
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CONCLUSIONS 
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1.  Project  Inspect,  Phase  II,  has  successfully  proved  that  the 
MAVIS  Model  can  produce  inspection  schedules  and  checklists 
that  provide  increased  inspection  efficiency  at  reduced 
cost  without  jeopardizing  aircraft  safety.  In  addition, 
the  integration  of  the  MAVIS-designed  phased  inspection 
checklist  into  Army  operational  activity  was  accomplished 
with  ease  and  was  well  received  by  Fort  Campbell  user 
personnel . 

2.  Statistical  calculations  also  showed  that  the  field  evalua- 
tion was  successful.  Confidence  levels  for  availability 
and  maintenance  man-hours  per  flight  hour  were  computed  for 
each  battalion  used  in  the  test.  The  calculations  indicated 
an  83  to  98  percent  confidence  that  the  test  companies  pro- 
duced better  availability  and  fewer  MMH/FH  than  the  control 
companies . 

3.  The  largest  problem  faced  by  the  field  evaluation  was  ac- 
curate data  recording.  Line-by-line  review,  correction, 
and  transcription  was  utilized  to  improve  the  process.  It 
can  be  concluded  that  data  collection  within  the  Army  must 
be  controlled  for  it  to  be  useful  in  maintenance  planning. 

4.  Aviation  unit  personnel  are  subject  to  too  much  paperwork, 
particularly  that  which  is  imposed  by  TAMMS.  The  net  ef- 
fect is  less  time  spent  on  active  operational  duties  and 
perhaps  lower  morale  in  some  instances. 

5.  Data  recording  and  data  collection  training  within  the  Army 
is  inadequate.  Few  new  men  knew  how  to  adequately  complete 
a 2407  TAMMS  form. 

6.  Project  Inspect,  Phase  II,  field  activity  resulted  in  a 
semicontrolled  data  collection  program  rather  than  a con- 
trolled field  evaluation.  (Semicontrolled  data  collection 
is  where  the  trooper  fills  out  the  form  and  a technical  as- 
sistance representative  of  the  commodity  command  reviews, 
edits,  collects,  and  forwards  it  to  the  national  level. 
Controlled  data  collection  utilizes  commodity  command  per- 
sonnel to  record  and  collect  the  data  with  no  requirements 
placed  on  field  personnel.) 
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Initial  implementation  of  the  Phased  Inspection  System 
throughout  Army  Aviation  will  produce  savings  and  redistri- 
bute inspection  labor  to  a point  where  as  much  time  is 
spent  performing  daily  inspections  as  there  is  in  perform- 
ing major  inspections.  (Refer  to  Figure  37.) 

The  new  Phased  Inspection  Checklist  Format  developed  during 
the  program  is  expected  to  improve  the  quality  of  component 
status,  deficiencies  found,  and  repair  action  recording. 
Furthermore,  a thorough  local  aircraft  record  will  be  avail- 
able for  new  company  maintenance  personnel  to  research  past 
aircraft  maintenance  problems. 


RECOMMENDATIONS 


1.  MAVIS  designed  Phased  Inspection  Schedules  should  be  imple- 
mented for  other  aircraft  in  the  Army  inventory  and  for  new 
aircraft  that  are  scheduled  to  become  a part  of  the 
inventory. 

2.  Once  an  inspection  schedule  becomes  operational,  it  should 
be  periodically  reexamined  and  updated  using  the  same  de- 
sign technique  that  it  was  implemented  by  (MAVIS  Analysis). 

3.  Army  aviation  should  follow  the  lead  of  other  commodity 
commands  and  simplify  current  TAMMS  data  recording  require- 
ments. For  example,  many  of  the  forms  required  today  fur- 
nish duplicate  information.  Some  of  these  can  be  eliminated 
or  combined,  resulting  in  more  efficient  data  collection. 

4.  Sample  Data  Collection  (SDC)  should  be  widely  used  to  pro- 
vide needed  maintenance  planning  data.  It  is  recommended 
that  the  semicontrol led  method  of  SDC  be  employed.  One 
AVSCOM  or  contractor  field  representative  should  be  resi- 
dent with  each  Aviation  Company  where  SDC  is  used. 

5.  The  inefficiencies  and  inaccuracies  of  TAMMS  data  recording 
and  collection  can  be  largely  overcome  with  field-implemented 
hardware  computer  processing  aids.  Therefore,  it  is  recom- 
mended that  SDC  aviation  implementation  employ  simple,  low- 
cost  field  processing  systems  with  data  correcting  (inter- 
active) hand-held  or  fixed  data  entry  terminals.  The  same 
system  should  be  programmed  to  provide  needed  operational 
data  for  company,  battalion  and  group  AMOs  and  COs . The 
SDC  hardware  should  be  compatible  with  ATSS,  the  avionic 
test  system  to  be  implemented. 

6.  Improved  MOS  training  in  TAMMS  data  collection  principles 
and  data  recording  practices  should  be  undertaken.  Practi- 
cal data -recording  classroom  exercises  are  recommended  for 
inclusion  in  the  instructional  curriculum.  Added  SDC 
topics  should  also  be  covered.  On-post  on-the-job  training 
(OJT)  programs  and  lectures  are  also  recommended. 
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7.  Under  the  phased  inspection  schedule,  field  results  have 
shown  that  the  daily  inspection  assumes  a greater  propor- 
tion of  total  inspection  labor  requirements  (over  40  per- 
cent). It  is  believed  that  this  requirement  can  be  reduced 
via  a systems  engineering  analysis  and  the  reorganization/ 
rewriting  of  the  PMD  checklist.  It  is  recommended  that  such 
an  analysis  be  performed  and  the  resulting  PMD  checklist 
field  tested. 

8.  Further  development  of  the  MAVIS  Model  is  advised.  For  a 
given  set  of  conditions,  the  model  can  be  programmed  to 
select  an  "optimum"  inspection  interval  or  provide  a "fig- 
ure of  merit"  for  inspection  intervals  in  a sensitivity 
run.  Additionally,  TOS  sensitivity  data  outputs  can  be  in- 
corporated to  determine  component  candidates  for  the  appli- 
cation of  new  inspection  methods  or  tools.  Cost  analyses 
could  then  determine  where  such  application  would  be  most 
beneficial  and  lead  to  research  efforts  in  these  areas. 
Finally,  the  model  could  be  modified  to  provide  inspection 
schedule  data  suited  to  a wartime  scenario.  Penalties  can 
be  assessed  for  unscheduled  repairs  and  similar  activity. 

One  or  more  of  the  above  research  and  development  efforts 
are  recommended. 


145 


REFERENCES 


1.  Interim  Technical  Report,  Tasks  I-V,  Project  Inspect  Phase 
II,  Fred  W.  Hohn,  Bruce  B.  Wierenga,  et  al.,  RCA  Technical 
Report  CR76-588-007,  Burlington,  Mass.,  Prepared  for  Eustis 
Directorate,  U.S.  Army  Air  Mobility  Research  and  Develop- 
ment Laboratory,  Fort  Eustis,  Va . 23604,  March  1976. 

2.  MAVIS  User's  Manual,  James  M.  Bardis,  Ted  E.  Kupfrian,  et 
al.,  RCA  Technical  Report  CR76-588-008 , Burlington,  Mass., 
Prepared  for  Eustis  Directorate,  U.S.  Army  Air  Mobility 
Research  and  Development  Laboratory,  Fort  Eustis,  Va.  23604, 
April  1976. 


146 


APPENDIX  A 


PHASED  INSPECTION  CHECKLIST,  UH-1H  HELICOPTER 


PHASED 

INSPECTION  CHECKLIST 
UH-1  HELICOPTER 


Prepared  Under 

Contract  No.  DAAJ02-74-C-0044 
1 April  1976 
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APPENDIX  B 

CONFIDENCE  METHODOLOGY,  CALCULATIONS  AND  RESULTS 


In  addition  to  soliciting  comments  from  field  operational  per- 
sonnel as  to  the  practicality  and  acceptabil ity  of  the  phased  in- 
spection system,  a statistical  analysis  was  made  to  determine  if 
the  phased  inspection  schedule  was  superior  to  the  intermediate/ 
periodic  (PMI,  PMP)  schedule.  Confidence  calculations  were  per- 
formed after  all  field  data  was  gathered  testing  the  variables  OR 
and  MMH/FH  to  determine  if  the  field  test  was  statistically  suc- 
cessful. This  appendix  reports  on  the  methodology  used,  the  cal- 
culations made  and  the  results  achieved. 

CONFIDENCE  METHODOLOGY 


The  methodology  used  was  to  analyze  MMH/FH  and  OR  data  for  all 
120  data  points  (aircraft)  gathered  during  the  test.  It  con- 
sisted of  two  basic  steps: 

1.  Preparatory  analysis  estimating  the  mean  (X)  and  standard 
deviation  (a)  to  eliminate  extraneous  data  points  (hanger 
queens , etc  . ) . 

2.  Calculations  to  determine  whether  the  average  of  one  group 
exceeds  the  average  of  the  other  group  and  the  confidence 
level  for  each  field  result  tested.  This  was  based  on  the 
analysis  of  measurement  data  procedure  provided  in  the  en- 
gineering design  handbook  AMCP706-110* . 

Preparatory  Analysis  and  Calculations 

The  raw  data  for  the  analysis  was  provided  by  the  Data  Management 
System.  Figures  B-l  through  B-6  present  the  input  data  used  on  a 
company  basis.  Note  that  only  the  variables  MMH  PER  FLT-HR  (last 
column)  and  OR  PERCENT  (second  column)  were  tested.  Thus,  with 
the  six  companies,  120  data  points  (60  test  and  60  control  were 
used  for  each  variable  in  the  analysis. 


♦Engineering  Design  Handbook  AMCP706-110,  Experimental  Statistics, 
Section  1,  Basic  Concepts  and  Analysis  of  Measurement  Data,  AMC 
Pamphlet,  Headquarters,  U.S.  Army  Materiel  Command,  December 
1969. 
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Figure  B-l.  Confidence  Calculation  Data  Points,  B Company,  101st  BN. 
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Figure  B-2.  Confidence  Calculation  Data  Points,  D Company,  101st  BN. 
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Figure  B-3.  Confidence  Calculation  Data  Points,  D Company,  158th  BN. 
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Figure  B-4.  Confidence  Calculation  Data  Points,  C Company  101st  BN 
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Figure  B-5.  Confidence  Calculation  Data  Points,  B Company  158th  BN. 
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4. 


Figure  B-6.  Confidence  Calculation  Data  Points,  C Company,  158th  BN. 


The  preparatory  analysis  performed  was  designed  to  locate  data 
points  which  were  more  than  two  standard  deviations  away  from  the 
mean.  Once  these  data  points  were  found  they  were  deleted  from 
the  analysis.  A small  computer  program  was  written  to  perform 
this  analysis.  A listing  of  the  program  is  provided  in  Figure 
B-7.  Input  to  the  program  was  the  aircraft  program  ID  No.  and 
the  variable  to  be  tested,  either  MMH/FH  or  OR.  Example  output 
of  the  program  is  provided  in  Figures  B-8  through  B-13.  These 
figures  illustrate  the  initial  use  of  the  program,  one  for  each 
company.  To  explain  the  output  printout  and  the  analysis  proce- 
dure, Figure  B-8  will  be  discussed. 

Figure  B-8  consists  of  four  columns  of  numbers.  Column  1 lists 
the  aircraft  ID  numbers  followed  by  the  total  number,  in  this 
case  20.  Column  2 is  the  input_value  of  MMH/FH  for  each  aircraft 
followed  by  the  computed  mean  (X)  for  all.  Column  3,  labeled  1, 
is  the  error  vrlue  or  the  value  minus  the  mean.  It  is  followed 
by  the  sum  of  column  3,  the  sum  of  the  errors,  a very  small  num- 
ber. Column  4,  labeled  2,  is  column  3 squared.  The  total  of 
this  column  can  be  written  as 


i <xi  - *>2 

i=l 

2 

which  is  the  sample  estimate  of  variance  (s  ) multiplied  by  n-1 
as  is  noted  on  page  1-10  of  AMCP706-110.  To  determine  which  data 
points  are  the  extraneous  ones,  the  analyst  must  first  compute 
the  standard  deviation,  double  the  value  (la),  and  compare  it  with 
the  values  of  column  3.  If  the  absolute  vaue  of  any  values  in 
column  3 exceeds  the  la  value,  they  are  discarded.  Note  that 
this  is  a repetitive  process;  once  the  calculations  are  made  and 
some  data  points  removed,  the  calculations  are  made  again  to  de- 
termine if  the  la  value  is  exceeded  in  the  smaller  data  set.  Us- 
ing the  example  of  Figure  B-8,  the  la  value  is  computed  as  follows 


As  noted  earlier  the  sum  of  column  3,  30.5534  equals  - 


n 

30.5534  - y (X  -X)2 


s2  (n-1)  = £e2 
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P*C£  I 1 


HA9 l 3/31/78 

II  4010  DM  I*  (13)  ,8  12!  ,n  (60}  ,¥  (4) 

21  4020  INPUT  "INPUT  PlLEf.lS 

Ji  x*jx  open  pile  u.JJ  , is 

41  0012  0*EN  PIlE[0.11,*SlPT* 

si  0035  input 

81  4040  LET  NaP 

y I 4045  LET  Jap 

SI  0PS0  INPUT  PILE tl) ,*,B m ,8(2) I 
91  4060  IP  EOP ( 1 J Then  COTO  0299 

141  4074  LET  Npn* 1 

III  4000  LtT  S"S*BCJ) 

121  0999  L 0 T 0 4050 

111  4200  PNINT  "POlfcT|a"|N 

141  0214  LET  MaS/N 

151  4220  PRINT  "HEAP  •*|H 

i6i  4219  close  pile  til 

171  0240  OPEN  PlLEtl.ll .11 

161  4250  POP  I • l TO  4 

191  0269  LET  V (11  a0 

201  4270  NEXT  I 

211  4260  PRINT  PILEtxl,"  10  VALUE  l 2 3” 

221  0290  let  PSa"«8«0  aa.aaaa  •aa.aaaaaa  aaaa.aaaa  .aaaaa.aaa  aaaaaa, 

211  0300  Input  file  tl) ,A,S  [1]  ,0  (21  I 

241  4110  IP  EOP(l)  THEN  SOTO  050® 

251  4324  LET  Dae (J) *H 

261  4310  LET  V 111  a»  (11 *0 

271  0140  LET  V (21  av (2) aOaD 

201  0350  LET  V t31  ay  til  aOaOaO 

291  4355  LET  V t4] ay (41 aOaOaOaO 

101  0364  PRINT  PILE  [0]  .USING  PS . A . • t J 1 . 0 « Oa(l , OaOaD . n*0*0*0 

111  0390  GOTO  0140 

J2I  4500  PRINT  PILE  (0) 

111  0510  PRINT  PILE  [0]  .USING  Pl.N.N.Vtt]  , V ( 3 1 ,9(31  .9(4) 

341  4515  PRINT  PILE (41 ,*  • 

351  4520  PRINT  FILE  (01  ,,,,$QR(y(2)/N),SO0(V(2}/(N*N)) 

iei  4530  close  file  id 

37i  4544  close  file  tei 

361  4590  GOTO  0020 


Figure  B-7.  Preparatory  Analysis  Computer  Program  Listing. 
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INPUT  P ILE I TEST  i 
J*2 


•OINTS* 
NE  AN  • 

20 

4,2279 

ERROR 

ERROR  SQUARED 

ID 

VALUE 

1 

2 

mi 

3.86 

•.347901 

,120797 

1102 

6.17 

1.9429 

J , 7733 

1103 

2.M 

-1.9179 

2,30261 

1104 

3.41 

-.617301 

,666308 

1109 

3.92 

-.307901 

9 ,439676-2 

1106 

3.67 

-.397901 

.127807 

1107 

4.42 

,102499 

3,703996-2 

1106 

3.62 

-.407301 

,166037 

1106 

3,94 

-.287901 

,082697 

1110 

4.42 

,192499 

3 , 70399E-2 

1111 

3,06 

-, 347901 

,120737 

1112 

6,33 

* 4,1023 

16,6305 

1113 

4,32 

9,249666-2 

8.3S602E-3 

1114 

4.36 

.132499 

.023296 

1119 

3,96 

-.647901 

,419258 

1116 

2.99 

-1.2779 

1,63201 

1117 

9.19 

,982499 

,926404 

1116 

3,91 

-.317901 

,100807 

1119 

2.99 

-1.6373 

2.88141 

1120 

4,86 

,632499 

.400053 

20 

4.2279 

-2.002726-3 

30.5534 

Figure  B-8.  Initial  Preparatory  Analysis  Program  Output  for 
MMH/FH,  B Company  101st  BN. 


input  e ile i test2 
J*2 


POINTS* 

20 

ERROR 

ERROR  SQUARED 

9EAN  • 

4,1449 

10 

VALUE 

« 

4 

2 

1201 

4.92 

,3733 

.141 

1202 

4.23 

8 , 94968E-2 

7.31009E-3 

1203 

3.23 

-.914901 

,636312 

1204 

3.1 

-1.0445 

1.09098 

1205 

3,93 

-.2149 

4,601046-2 

1206 

8.31 

* 2.1653 

4,68939 

1207 

2.6 

•1,9449 

2,36948 

1206 

4,33 

.189499 

.03441 

1209 

3.6 

,4353 

,20748 

1210 

4,96 

.819499 

,669039 

1211 

2,99 

•1.1943 

1.42683 

1212 

4,84 

.899499 

.483719 

1213 

4.16 

1,949916-2 

2 , 40223E-4 

1214 

3.8 

,839499 

. 4 2 9 6 K 

1213 

3.34 

.395499 

,19842 

1216 

6,03 

1,8699 

3,3391 1 

1217 

3,77 

-.3749 

,14025 

1216 

3,69 

-, 494301 

.244331 

1219 

4.32 

.173499 

3.07999F-2 

1220 

2,02 

••2.1245 

4.9139 

20 

4,1449 

-1.333146-3 

21.0843 

Figure  B-9.  Initial  Preparatory  Analysis  Program  Output  for 
MMH/FH,  D Company  101st  BN. 
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INPUT  FILEITESTJ 
J*2 


POINTS*  20 
HEAN  ■ 4,911 

ERROR 

ERROR  SQUARED 

10 

VALUE 

1 

2 

1301 

3.99 

-1,031 

1 ,0929ft 

1302 

9.19 

1,269 

1 ,61030 

1343 

9,64 

,729 

,931441 

1304 

9,31 

1.399 

1,8972 

1349 

4,37 

-.941 

.292601 

1349 

9,99 

.749 

,961 

1 30T 

4,41 

-.901 

.291001 

1309 

<.8 

-.111 

.012321 

1349 

4.99 

-.321 

,103041 

131P 

9.09 

,169 

2.85609E-2 

1311 

4.33 

-.981 

.337541 

1312 

6,47 

1.999 

2,43046 

1313 

9,09 

.179 

,032041 

1314 

9.41 

,499 

,249001 

1319 

4.92 

-.391 

,152881 

1319 

3.99 

-, 931001 

,446762 

1317 

3,49 

-1.431 

2,04776 

1319 

4.12 

-.791 

,829682 

1319 

9,44 

,929999 

.27984 

1329 

4,46 

-.491 

,203401 

20 

4.911 

-4.76837E-6 

13.639 

Figure  B-10.  Initial  Preparatory  Analysis  Program  Output  for 
MMH/FH,  D Company  158th  BN. 

input  pileiconti 
J*2 

POINTS*  20 


4EAN  • 

4,6179 

ERROR 

ERROR  SQUARED 

10 

VALUE 

1 

2 

2101 

9.02 

,402499 

,162006 

2102 

4,89 

.272499 

7 .42558E-2 

2103 

8,09 

1.4329 

2,05205 

2104 

9,17 

,992499 

,309295 

2109 

*.2 

-.417901 

, 174307 

2180 

6.7 

• 2,0829 

4,3368 

2147 

4.49 

-.127501 

1 .62966E-2 

2106 

4,62 

2 , 49863E-3 

6.24313E-6 

2109 

9 

,382499 

,144305 

2110 

9,92 

,002499 

.814909 

2111 

3,74 

-,877501 

,770009 

2112 

4.44 

-,177502 

3.19068E-2 

2113 

4.92 

,302499 

9 , 1 5059E-2 

2114 

4,92 

■9 , 79008E-2 

9 , 5064E-3 

2119 

4,13 

-,467901 

.237657 

2116 

3,76 

-.897901 

,735308 

2117 

9,47 

.892499 

,726755 

2116 

3.41 

-1,2079 

1,45808 

2119 

3.38 

-1.2379 

1,93141 

2120 

2,92 

-1,6978 

2.94191 

29 

4.6179 

■2.3841 9C-9 

16.559 

Figure  B-ll.  Initial  Preparatory  Analysis  Program  Output  for 
MMH/FH,  C Company  101st  BN. 


INPJT  FILEIC0NT2 
J*2 

POINTS*  20 


nEAn  ■ 

3,336 

ERROR 

ERROR  SQUARED 

ID 

VALUE 

1 

2 

2201 

4,92 

• ,436 

, t 90096 

22B2 

*.6 

• ,756 

,371333 

2203 

3,34 

,184 

,033836 

220* 

6,98 

1,624 

2,63737 

2203 

6.39 

1,234 

1,32276 

2206 

3,23 

• ,126 

1 .38761E-2 

2207 

4,92 

-.436 

,190096 

2208 

3.44 

8,30996f-2 

7.03394E-3 

2200 

9.43 

* 4, *04 

16,7606 

2210 

3,81 

.434 

,200116 

2211 

3.6 

,244 

5,033026-2 

2212 

3,3 

• 3 , 30998E  »2 

3.133076-3 

2213 

3,22 

■ ,136 

1.849396-2 

221* 

4,68 

.,476 

,226378 

2213 

3,18 

•2.176 

4.73407 

2218 

6.08 

.724 

.324176 

2217 

7 • 1 4 

1.784 

3,18266 

2218 

4,09 

•1.266 

1.60276 

2219 

3,17 

•2,186 

4,77839 

2220 

2,98 

•2,376 

3,84338 

20 

3,336 

1.027336-6 

42,9119 

Figure  B-12.  Initial  Preparatory  Analysis  Program  Output  for 
MMH/FH,  B Company  158th  BN. 

INPUT  PILtlCONTJ 
J *2 

POINTS*  20 


1EAN  • 

3,309 

ERROR 

ERROR  SQUARED 

10 

value 

1 

2 

2301 

6,39 

1.281 

1,64096 

2302 

3.91 

•1.399 

1.9372 

2303 

7.48 

♦ 2.171 

4,71324 

2304 

6.7 

1,391 

1.93488 

2303 

4,89 

-.419 

.173361 

2346 

7,06 

1,771 

3.13644 

2307 

3,83 

,341 

,292681 

2306 

4,63 

-.439 

,210681 

2309 

3,32 

.211 

4,432126-2 

2310 

3,37 

6.09999E-? 

3,720986-3 

2311 

3,93 

.621 

,383641 

2312 

6,39 

1.281 

1,6*096 

2313 

3.1 

-.209 

4.368086-2 

2314 

3.12 

-.160 

,033721 

2313 

3.71 

•1.399 

2.3368 

2316 

3,29 

-1 .90001E-2 

3.61002E-4 

2317 

3.9 

-1,409 

1,98528 

2318 

3.8 

-1,509 

2.27708 

2319 

4,67 

-.439 

.192721 

2320 

3.63 

•1.670 

2,61904 

20 

3.309 

0 ,3367  4E-7 

26,8472 

Figure  B-13.  Initial  Preparatory  Analysis  Program  Output  for 
MMH/FH,  C Company  158th  BN. 
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Therefore  s,  or  approximate  a equals  - 


30.5534  = 1.2681 

19 

n-1 

2 <r  = 2.5362 

Note  that  ID  No.  1112' s absolute  error  exceeds  the  2 a value  and 
was  removed  from  the  analysis.  This  fact  is  denoted  by  an 
asterisk.  Similarly,  the  2 a analysis  was  performed  on  the  other 
companies  and  is  similarly  indicated  in  Figures  B-9  through 
B-13. 

The  initial  preparatory  analysis  was  performed  for  each  company 
for  both  variables  tested,  MMH/FH  and  OR.  The  parameters  cal- 
culated were  company  sample  size  (n) , mean  ^X) , and  sample  es- 
timate of  variance  multiplied  by  n-1  or  >e  . Table  B-l  pro- 
vides the  summary  values.  ^ 

TABLE  B-l.  COMPANY  SUMMARY  ANALYSIS  DATA. 


Company 

n 

MMH/FH 

x y 

n 

OR 

X 

^2 

B-lOlst 

BN 

18 

3.8917 

7.9194 

19 

76.8895 

1042.94 

D-lOlst 

BN 

18 

4.1422 

11.8815 

17 

78.8059 

768.63 

D-158th 

BN 

20 

4.9110 

13.6360 

18 

81.3056 

531.25 

C-lOlst 

BN 

19 

4.5079 

11.9899 

17 

74.4176 

795.41 

B-158th 

BN 

18 

5.2606 

20.3417 

16 

83.2938 

298.63 

C-158th 

BN 

19 

5.1947 

21.0859 

18 

76.1667 

984.28 

The  first  three  companies  listed  in  Table  B-l  compose  the  test 
group  while  the  last  three  compose  the  control  group.  Note  for 
the  variable  MMH/FH  that  the  mean  value  for  D/158  is  significantly 
different  than  the  others  in  the  test  group.  Similarly  in  the 
control  group,  C/101's  mean  value  for  MMH/FH  is  significantly  dif- 
ferent from  the  rest  of  the  control  group.  This  was  the  first 
indication  that  maintenance  work  was  performed/ reported  differ- 
ently between  battalions  and  that  the  test  group  versus  control 
group  samples  might  not  be  statistically  the  best  sample  to  use 
as  was  originally  planned. 
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k. 


Confidence  Calculation  Methodology 


The  confidence  procedure  used  relied  on  the  design  handbook  text 
AMCP706-110.  The  procedure  is  described  in  Paragraph  3-3,  Case 
2,  Subparagraph  3-3. 2. 2.  Briefly,  the  test  is  to  determine 
whether  "the  average  of  material,  product  or  process  A exceeds 
that  of  material,  product,  or  process  B".  In  our  case,  we 
wanted  to  determine  if  the  MMH/FH  of  the  control  group  was  higher 
than  the  test  group  and  whether  the  OR  of  the  test  group  was 
higher  than  the  control  group.  Case  2 was  selected  which  states: 
"The  variability  in  performance  of  each  of  A and  B is  unknown, 
and  it  is  not  reasonable  to  assume  that  they  both  have  the  same 
variability. " 

AMCP706-110  specifies  the  following  procedure  for  this  case: 


1. 

2, 


Choose  a , the  significance  level  of  the  test. 

— 2 — 2 

Compute:  X and  S , X and  S , from  the  n and  n measure- 

ments from  A and  B.  B 


Compute : „ 

SA 

V.  = — 

A n. 

A 

and 

cz 

V - ^ 

B "B  • 

the  estimated  variances  of  X^  and  Xg,  respectively. 
Compute  the  "effective  number  of  degrees  of  freedom" 
(VA  + VB>2 

f - 3 h -2 


B 


n.+  1 
A 


+ 1 


Look  up  t^  for  f'  degrees  of  freedom  in  Table  A-4,  where 
f'  is  the  integer  nearest  to  f;  denote  this  value  by  t1. 

1 ••  dC 


Computer 
“ ■ ‘’i- 
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7.  If  (XA  - Xg)  > u,  decide  that  the  average  of  A exceeds  the 
average  or  B;  otherwise,  decide  that  there  is  no  reason  to 
believe  that  the  average  of  A exceeds  the  average  of  B. 


8.  Let  m.  and  hl  be  the_true_averages  of  A and  B.  Note  that 
the  intervalBfrom  ) (X  - X^)  - u ( to  is  approximately  a 
one-sided  100  (1  - « ) /„  confidence  interval  estimate  of  the 
true  difference  (m^  - m^) . 

Table  A-4  is  found  in  AMCP706-114*  and  is  reproduced  below. 

TABLE  B-2.  PERCENTILES  OF  THE  t DISTRIBUTION. 


s 

I. 

m 

tm 

tm 

tm 

tm 

1 

325 

727 

1.376 

3.078 

6 314 

12  706 

31  821 

63  657 

7 

289 

617 

1 061 

1 886 

2 920 

4 303 

6 965 

9 925 

3 

277 

584 

978 

1 638 

2 363 

3 182 

4 541 

5 841 

4 

271 

569 

941 

1.533 

2 132 

2 776 

3 747 

4 604 

5 

267 

569 

920 

1 476 

2 015 

2 571 

3 365 

4.032 

* 

265 

563 

906 

1 440 

1 943 

2 447 

3 143 

3 707 

7 

263 

549 

896 

1 415 

1 895 

2 365 

2 998 

3 499 

• 

262 

546 

889 

1 397 

1 860 

2 306 

2 896 

1 3 355 

* 

261 

543 

883 

1 383 

1 833 

2 262 

2 821 

1 3 250 

10 

260 

642 

879 

1 372 

1 812 

2 228 

2 764 

3 169 

11 

260 

540 

.876 

1 363 

1 796 

2 201 

2 718 

3 106 

11 

259 

539 

873 

1 356 

1 782 

2 179 

2 681 

3 0.6.6 

13 

259 

538 

870 

1 350 

1 771 

2 160 

2 650 

3 012 

14 

258 

537 

868 

1 345 

1 761 

2 145 

2 624 

2.977 

IS 

258 

536 

866 

1 341 

1.753 

2 131 

2 602 

2 947 

14 

258 

635 

866 

1 337 

1.746 

2 120 

2 583 

2 921 

17 

257 

534 

863 

1 333 

1.740 

2 110 

2 .567 

2 898 

13 

257 

534 

862 

1 330 

1 734 

2 101 

2 5.62 

2 878 

If 

257 

533 

861 

1 328 

1 729 

2 093 

2 539 

2 861 

30 

257 

533 

860 

1 325 

1 725 

2 086 

2 528 

2 845 

11 

267 

532 

869 

1 323 

1 721 

2 080 

2 518 

2 831 

n 

256 

532 

858 

1.321 

1 717 

2 074 

2 508 

2 819 

as 

256 

532 

858 

1 319 

1714 

2 069 

2 500 

2 807 

14 

256 

581 

857 

1 318 

1 711 

2 064 

2 492 

2 797 

IS 

256 

531 

856 

1 316 

1 708 

2 060 

2 485 

2 787 

14 

256 

531 

856 

1 316 

1 706 

2 056 

2 479 

2 779 

17 

256 

531 

855 

1 314 

1 703 

2 052 

2 473 

2 771 

It 

256 

530 

855 

1 313 

1 701 

2 048 

2 467 

2 763 

If 

256 

530 

854 

1 311 

1 699 

2 045 

2 462 

2 756 

SO 

256 

530 

854 

1 310 

1 697 

2 042 

2 457 

2 750 

40 

265 

529 

351 

1 303 

1 684 

2 021 

2 423 

2 704 

40 

254 

527 

848 

1 296 

1 671 

2 000 

2 390 

2.660 

130 

254 

526 

845 

1 289 

1 6.58 

1 980 

2 358 

2 617 

«0 

253 

524 

842 

l“ 

1 645 

1 960 

2 326 

2 576 

*Engineering  Design  Handbook  AMCP706-114,  Experimental  Statistics, 
Section  5,  Tables,  AMC  Pamphlet,  Headquarters,  U.S.  Army  Materiel 
Command,  December  1969. 
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The  significance  level  of  the  test,  «,  was  specified  as  0.05. 
However,  the  confidence  sought  in  the  evaluation  results  was  80 
percent  as  stated  in  the  estimate  of  required  flying  hours  (36,000) 
provided  in  the  Project  Inspect  Phase  II  Proposal.  The  problem 
was  to  determine  the  confidence  achieved  by  testing  the  two  vari- 
ables and  seeing  if  the  80  percent  level  was  met  or  exceeded. 

The  above  procedure  was  used  in  a slightly  modified  form  to  make 
it  simple  to  determine  if  the  significance  level  of  the  test  was 
met.  The  modification  entailed  combining  steps  6 and  7 as  fol- 
lows : 

(XA  - xB)  > u - yvA  + VB 


Dividing  both  sides  by  y/V^  + ^ 

(the  definition  of  S) 
a /X a - Xn. 

& LA AL  „ 

> l-  « 

V + V * 

A B 


T » 


S. 


(definition  of  T) 


For  •<=  0.05  and  most  values  of  f,  is  approximately  1.65  to 

1.7.  Thus,  if  T is  greater  than  this,  the  test  is  passed  with 
greater  than  95  percent  confidence.  T can  be  thought  of  as  the 
number  of  standard  deviations  the  two  sample  means  are  apart. 


To  recap: 


With  this  modification  we  need  to  compute  X for  each  sample  to  be 
compared,  calculate  the  effective  number  of  degrees  of  freedom 
(f),  calculate  S,  and  calculate  T.  If  T exceeds  the  value  1.65, 
the  test  has  passed. 


The  calculations  for  f and  S were  also  performed  on  the  computer. 
Figure  B-14  is  the  listing  for  that  program.  When  run,  it  prints 
out  six  values  as  follows: 


51 
N1 

52 
N2 

S 

f 


^ 2 

= e > Sample  1 
= Sample  1 Size 
= ^e",  Sample  2 
= Sample  2 Size 


"+  VB 


= Degrees  of  Freedom 


Inputs 


Outputs 
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- 


11 

***S 

4 

/ 1 /7o 

«SF 

21 

**3* 

OPEN  i 

file  t 

11 

, "*lfm  " 

41 

*1*4 

INPUT 

"Si, 

*11" 

,S1 ,Ni 

41 

413* 

PWINT 

file 

t*J  , 

"S 1 ■ " | 3 1 

31 

* 1 81* 

P*  I NT 

file 

lid)  , 

"Nlft"|Kll 

91 

up  *4 

Input 

MS2 , 

N2I  " 

,S2,N2 

7 1 

423* 

P9INT 

file 

r*j , 

"S2ft"»S2 

81 

426* 

PrflNT 

file 

f*j , 

"Npft " i N2 

91 

*44* 

LfcT  V 

1 »S  1 ✓ 

(M  * 

CM-1)) 

1*1 

*314 

LET  V2*S2/ 

(n2* 

(N2-D) 

111 

*32* 

let  s 

■ S nP( 

vl*v 

2) 

121 

*33* 

PHINT 

FILE 

1*1 , 

"Sft*»IS 

1 <5 1 

*34* 

LET  F 

■ 1*1  + 

V2)  a 

2/(Vl*Vl/(M4l)*V2ftvP/{N2*U)ft2 

141 

*33* 

PWInT 

file 

(*)  , 

"F  ■ " 1 F 

131 

*36* 

PWINT 

S,F 

lot 

*3/* 

PKINT 

FILE 

1*1 

Figure  B-14.  Confidence  Calculation  Program. 
CALCULATION  RESULTS 


Initially,  it  was  desired  to  perform  confidence  calculations  on 
the  test  versus  control  group  variables  MMH/FH  and  OR.  The  pro- 
cedure to  do  this  is: 

1.  Perform  preparatory  analysis^on  the  two  samples  to  be 
compared.  (Determine  X,  ^fe  , n) 

2.  Perform  confidence  calculations  (Determine  f and  S) 

3.  Calculate  T and  compare  with  1.6. 

This  procedure  was  followed  for  the  test  versus  control  group  and 
the  results  are  depicted  below: 

MMH/FH 

4 * 


f = 109.5 

S = 0.184 

T = 3.51 


TEST 

GROUP 

X = 

4.3363 

£.2- 

44.2792 

n = 

56 

CONTROL 

GROUP 

X = 

4.9829 

Ife2  - 

59.9447 

n = 

56 

f ■*  104 

S = 1.4 

T = 0.82 


Note  that  the  MMH/FH  group  test  passes  but  the  OR  group  test  does 
not.  This  led  to  further  analysis  of  the  input  means  on  a company 
basis.  The  hypothesis  was  made  that  the  companies  in  the  groups 
could  be  from  different  populations.  To  test  this  out,  tests  of 
the  same  type  were  made  between  companies  in  the  same  group  but 
in  different  battalions.  These  are  indicated  below  as  the  ver- 
tical comparisons  for  MMH/FH. 


TEST  GROUP 
X = 78.9648 
£e2=  2523.70 
n = 54 


CONTROL  GROUP 
X « 77.8196 
£e2=  2803.70 
n = 51 


TEST  SAMPLES  CONTROL  SAMPLES 


The  resulting  significance  proved  that  the  companies  in  the  same 
group  but  from  different  battalions  were  indeed  from  different 
populations  for  the  variable  MMH/FH.  Similarly  the  same  tests 
were  made  for  the  variable  OR  and  the  results  are  depicted  below: 
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TEST  SAMPLES 


COt1  TROL  SAMPLES 


/ 


j B&D/101BN 

X 

= 77.7944 

ie2 

= 1844.5200 

n 

= 36 

h 

f = 

45.3 

s = 

1.79 

T = 

1.96 

* 

| D/158BN 

X 

= 81.3056 

= 531.2490 

n 

= 18 

f 

S 

T 


34.1 


C/101BN 

X = 

74.4176 

*e2  - 

795.4050 

n = 

17 

OR 


f = 34.6 
S = 2.11 
T = 2.42 


45.3 

1.8 


B&C/158 

BN 

X = 

79.5206 

2,e  = 

1713.1700 

n = 

34 

The  same  significance  again  resulted.  It  is  apparent  then  that 
separate  samples  should  be  used  for  the  confidence  test  other 
than  the  original  test  and  control  groups.  In  other  words,  it 
makes  more  sense  statistically  to  compare  test  versus  control 
companies  within  the  same  battalion.  This  led  to  the  analysis  of 
two  test  versus  two  control  samples.  The  battalion  confidence 
calculation  results  are  given  on  the  four  box  diagrams  underneath 
the  horizontal  connecting  lines.  Note  that  both  variables  OR  and 
MMH/FH  for  the  158th  BN,  the  T = 1.65  criterion  was  not  met. 

That  meant  the  one  sided  95  percent  confidence  interval  estimate 
of  the  true  difference  between  the  averages  for  the  methods  was 
not  obtained.  However,  a lessor  confidence  interval  estimate  is 
associated  with  the  T numbers  indicated.  These  may  be  determined 
by  referring  to  Table  A-4  and  interpolating  the  confidence  inter- 
val estimate  (the  t subscript  number).  To  do  this  accurately,  a 
graph  of  the  t distribution  was  made.  (t  subscript  versus  tabu- 
lar value  for  constant  degree  of  freedom.)  Confidence  level 
values  were  then  obtained  from  the  use  of  the  graph  and  are  given 
in  Table  15  of  the  main  text.  Note  all  exceed  the  original  pro- 
jection of  80  percent. 
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APPENDIX  C 

OR  AND  MMH/FH  BATTALION  DATA 

This  appendix  presents  OR  and  MMH/FH  data  for  the  two  battalions 
participating  in  the  field  evaluation  at  Fort  Campbell.  The  data 
has  been  reorganized  from  that  in  the  main  body  of  the  report  to 
provide  visibility  to  the  confidence  results. 

Confidence  calculations  (Appendix  B)  showed  that  the  test  versus 
control  group  samples  studied  at  length  during  the  field  test  did 
not  have  the  proper  qualifications  from  a statistical  viewpoint 
to  be  considered  as  a sample  indicative  of  the  total  UH-1H  fleet. 
Appendix  B showed  that  there  is  a high  confidence  that  the  two 
battalions  are  from  completely  different  populations.  That  anal- 
ysis recommended  that  the  confidence  estimate  for  the  field  results 
be  confined  to  battalion  comparisons  as  is  shown  in  Table  15. 

Each  battalion  was  divided  in  test  and  control  samples  as  follows: 

Test  Sample  Control  Sample 

101st  BN  B&D  Companies  C Company 

158th  BN  D Company  B&C  Companies 

For  analysis  purposes,  each  of  these  samples  can  be  looked  at  in 
terms  of  OR  and  MMH/FH  data.  Tables  C-l  and  C-2  present  that 
data  for  each  sample  as  it  was  gathered  and  summed  cumulatively 
by  the  Data  Management  System.  Interested  parties  may  want  to 
compare  these  tables  with  Table  7 (OR)  and  Table  6 (MMH/FH) of  the 
main  report.  The  MMH/FH  data  is  also  presented  in  graphical  form 
in  Figures  C-l  (101st  BN)  and  C-2  (158th  BN).  The  data  shown  is 
cumulative  monthly  which  is  slow  to  show  a true  trend  once  the 
data  bank  has  been  biased  in  one  direction.  Both  Figures  illus- 
trate differing  behavior  over  the  first  few  months  of  the  program. 
This  probably  reflects  different  data  recording  practices  in  each 
battalion  and  non-uniform  data  gathering  as  compared  with  the  re- 
quirements of  Project  Inspect.  It  wasn't  until  the  fifth  month 
of  the  program  that  a Data  Recording  Guide  was  issued  to  all 
participating  troops.  This  started  a learning  cycle  through 
weekly  class  instruction  and  OJT  in  uniform  Project  Inspect  data 
recording.  That  this  training  was  successful,  is  amply  illustra- 
ted in  both  figures  in  the  smoothing  out  of  the  curves. 
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TABLE  C-l.  101ST  BATTALION  SAMPLE  TEST/CONTROL  CUMULATIVE 

STATUS  (OR  PERCENT)  AND  MAINTENANCE  RESULTS  (MMH/FH) . 

TEST  SAMPLE  CONTROL  SAMPLE 

B&D  COMPANIES  C COMPANY 


MONTH 

OR 

MAINT  RATIO 

OR 

MAINT.  RATIO 

1 

77.60 

3.125 

81.30 

3.470 

2 

77.70 

4.460 

79.40 

3.900 

3 

77.25 

4.435 

74.60 

3.700 

4 

78.30 

5.175 

75.80 

3.930 

5 

79.85 

5.245 

77.20 

4.080 

6 

79.90 

5.020 

76.40 

3.940 

7 

79.30 

5.215 

76.00 

4.190 

8 

78.90 

4.715 

75.70 

4.210 

9 

78.35 

4.660 

75.40 

4.800 

10 

77.80 

4.460 

76.10 

4.900 

11 

77.45 

4.315 

75.70 

4.650 

12 

77.55 

4.310 

73.40 

4.710 

13 

77.10 

4.265 

73.20 

4.830 

14 

76.50 

4.130 

73.60 

4.710 

15 

75.85 

4.040 

73.40 

4.520 
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TABLE  C-2 . 158TH  BATTALION  SAMPLE  TEST/ CONTROL  CUMULATIVE 

STATUS  (OR  PERCENT)  AND  MAINTENANCE  RESULTS  (MMH/FH) . 


TEST  SAMPLE  CONTROL  SAMPLE 

D COMPANY  B&C  COMPANIES 


MONTH 

OR 

MAINT.  RATIO 

OR 

MAINT.  RATIO 

1 

78.90 

4.950 

73.85 

5.245 

2 

79.60 

4.070 

72.40 

6.185 

3 

80.90 

5.250 

72.75 

5.610 

4 

81.60 

5.410 

72.80 

5.695 

5 

81.70 

5.910 

74.90 

6.335 

6 

81.70 

6.000 

76.55 

6.100 

7 

82.70 

6.180 

77.50 

5.885 

8 

83.30 

5.920 

78.65 

5.795 

9 

83.10 

5.710 

77.60 

5.375 

10 

82.50 

5.330 

76.60 

5.455 

11 

82.70 

5.000 

76.45 

5.450 

12 

82.40 

5.040 

76.95 

5.390 

13 

81.60 

4.930 

76.75 

5.340 

14 

80.30 

4.900 

76. 90 

5.205 

15 

78.80 

4.830 

77.00 

5.185 

The  OR  data  presented  in  Tables  C-l  and  C-2  is  difficult  to  in- 
terpret because  it  is  "goal"  oriented,  not  related  to  true  avail- 
ability, and  highly  affected  by  operational  conditions  (remote 
exercises,  aircraft  shortages,  maintenance  backlogs,  etc.)-  How- 
ever, broad  trends  can  be  analyzed  and  reasons  for  them  sought  as 
was  discussed  in  the  main  report.  Figure  22  of  the  main  report 
presented  test  and  control  group  data  in  monthly  increments  rather 
than  cumulatively  as  is  given  in  Tables  C-l  and  C-2.  Similarly, 
Figures  C-3  and  C-4  illustrate  battalion  OR  monthly  data.  These 
figures  amplify  the  group  curves  shown  in  Figure  22  as  they  are 
given  on  a company  basis.  Two  deviations  from  the  typical  opera- 
tional "zig-zags"  warrant  explanation.  The  first  is  the  C Company, 
101st  BN  very  low  OR  in  month  12.  The  second  is  the  sharp 
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Figure  C-l.  101st  Battalion  Cumulative  Maintenance  Results. 
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Figure  C-2.  158th  Battalion  Cumulative  Maintenance  Results. 
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Figure  C-3.  101st  Battalion  Monthly  Operational  Readiness 

Results . 
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158th  Battalion  Monthly  Operational  Readiness 
Results . 


Figure  C-4 
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declining  trend  of  OR  in  D Company,  158th  BN  during  the  last 
three  months  of  the  program. 

In  month  12  of  the  program, C Company,  101st  BN  reported  extensive 
NORM  time  on  15  of  their  20  aircraft.  A commanders  note  on  the 
1352  form  stated:  "Excessive  NORM  time  due  to  critical  lack  of 

experience  in  flight  and  service  platoon  and  many  maintenance  man- 
hours lost  due  to  parades,  parade  practice  and  preparation  for 
the  annual  I.G.  inspection". 

Excessive  NORM  time  is  also  given  as  the  reason  for  low  OR  during 
the  last  three  months  by  D Company,  158th  BN.  The  following  are 
quotes  from  the  last  three  1352  reports  by  the  commander: 

20  September  1975  - "Unit  exceeded  NORM  standard  because  of 
the  required  time  to  prepare  for  and  the  conduct  of  the  Annual 
General  Inspection  which  included  100  percent  inventory  and  in- 
spection of  all  tools  and  equipment.  Additionally,  the  majority 
of  MOS  qualified  personnel  (67N's)  in  the  Service  Platoon  are 
recent  AIT  graduates  and  therefore  lack  experience  at  unit 
level  maintenance". 

20  October  1975  - Same  as  above. 

20  November  1975  - "Unit  exceeded  NORM  standard  because  this 
reporting  period  was  begun  with  four  aircraft  undergoing  phase 
inspection.  Eight  additional  aircraft  entered  phase  and  a 
total  of  seven  phase  inspections  were  completed.  This  unit 
spent  a total  of  nine  days  in  the  field  during  this  period 
which  resulted  in  a heavier  than  normal  unscheduled  maintenance 
workload.  Two  aircraft,  68-16576  and  66-0832  were  in  direct 
support  maintenance  for  a total  of  1259  hours.  A total  of  six 
days  NORM  time  was  lost  on  aircraft  that  were  test  flight  status 
but  could  not  be  flown  due  to  weather  conditions.  The  above 
circumstances  were  all  significant  factors  that  caused  the  ac- 
ceptable NORM  rate  to  be  exceeded". 
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